00000001:02000400:2.0F:1788837661.552980:0:2946:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1788837671.635029:0:3147:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1788837673.845774:0:3205:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 491 MB/s 00000001:01000000:2.0:1788837674.101635:0:3205:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 495 MB/s 00000001:01000000:2.0:1788837674.352748:0:3205:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4191 MB/s 00000020:02000000:0.0F:1788837675.150957:0:3240:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_117_g424a755 00000400:02000000:3.0:1788837676.247946:0:3255:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.154@tcp [8/256/0/180] 00008000:02000000:2.0:1788837680.205404:0:3404:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788837737.631138:0:5213:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788837749.192857:0:5789:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788837749.192864:0:5789:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788837749.193015:0:5789:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000f5f56617 00000080:02000400:3.0:1788837749.193026:0:5789:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788837749.202508:0:5789:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788837749.202523:0:5789:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788837749.202571:0:5789:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000da19f1de) 00000020:00000080:3.0:1788837749.202604:0:5789:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788837749.219147:0:5789:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788837749.219604:0:5789:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788837749.238135:0:5789:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788837749.238171:0:5789:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788837749.238189:0:5789:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788837749.238584:0:5789:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788837749.238636:0:5789:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788837749.239224:0:5789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788837749.239233:0:5789:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788837749.239244:0:5789:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2deb895b363e5ff2 00000020:01000004:3.0:1788837749.239251:0:5789:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788837749.239256:0:5789:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788837749.239261:0:5789:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f5f56617 from MGS 00000020:01000004:3.0:1788837749.239266:0:5789:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788837749.239277:0:5789:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000058bf0c15) 00000020:00000080:3.0:1788837749.239289:0:5789:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788837749.239450:0:5789:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f5f56617 from MGS, refs=2 00080000:01000000:3.0:1788837749.239456:0:5789:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788837749.239462:0:5789:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2deb895b363e6000 00000100:00100000:3.0:1788837749.239563:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788837749.239893:0:5789:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788837749.239900:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788837749.240642:0:5789:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788837749.240661:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788837749.241672:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788837749.241912:0:5789:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788837749.241917:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788837749.242635:0:5789:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788837749.242642:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788837749.243006:0:5789:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788837749.243012:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788837749.243750:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837749.243754:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837749.243756:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837749.244166:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837749.244168:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837749.244170:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837749.244845:0:5789:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788837749.251444:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788837749.494241:0:5789:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2155 MB/s 00000001:01000000:3.0:1788837749.744467:0:5789:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3295 MB/s 00000001:01000000:2.0:1788837749.994878:0:5789:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 479 MB/s 00000001:01000000:3.0:1788837750.245374:0:5789:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 545 MB/s 00080000:10000000:2.0:1788837750.258989:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1788837750.291747:0:5789:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788837750.291764:0:5789:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788837750.291766:0:5789:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788837750.294811:0:5799:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788837750.294908:0:5789:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788837750.294969:0:5789:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1788837750.295312:0:5789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788837750.295350:0:5789:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788837750.295736:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788837750.295952:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788837750.295958:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00010000:00010000:1.0:1788837750.309610:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837750.313715:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788837750.313740:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788837750.317193:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788837750.317424:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788837750.318264:0:5789:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788837750.318289:0:5789:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.154@tcp' 00000020:01000004:3.0:1788837750.318291:0:5789:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788837750.318344:0:5789:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.154@tcp (typ=mgc) 00000020:00000080:3.0:1788837750.318357:0:5789:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.154@tcp (0000000025895935) 00000020:00000080:3.0:1788837750.318374:0:5789:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788837750.318471:0:5789:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003010831e@MGC192.168.204.154@tcp: add connection 192.168.204.154@tcp at head 00010000:00010000:3.0:1788837750.318653:0:5789:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.154@tcp-0 is initialized 00000040:01000000:3.0:1788837750.318659:0:5789:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788837750.319105:0:5805:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788837750.319134:0:5789:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.154@tcp (uuid e394dacb-3a10-4fe7-bf6d-0294b37a120d) 00000020:00000080:1.0:1788837750.319150:0:5789:0:(genops.c:1385:class_connect()) connect: client e394dacb-3a10-4fe7-bf6d-0294b37a120d, cookie 0x2deb895b363e600e 00000100:00080000:1.0:1788837750.319161:0:5789:0:(import.c:510:import_select_connection()) MGC192.168.204.154@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788837750.319167:0:5789:0:(import.c:624:import_select_connection()) MGC192.168.204.154@tcp: import 000000003010831e using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788837750.319305:0:5789:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d097d7c1 x1875732254949504/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788837750.319325:0:5789:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import e394dacb-3a10-4fe7-bf6d-0294b37a120d->MGS 00000020:01000004:1.0:1788837750.319341:0:5789:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788837750.319345:0:5789:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788837750.319363:0:5789:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000008293847a) 00000020:00000080:1.0:1788837750.319373:0:5789:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788837750.325957:0:3270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d097d7c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3270:1875732254949504:0@lo:250: 00000100:00100000:3.0:1788837750.326090:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837750.326394:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254949504 00000100:00100000:3.0:1788837750.326404:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254949504 00000100:00100000:3.0:1788837750.326439:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788837750.326447:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b8bf2d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3270:x1875732254949504:12345-0@lo:250: 00010000:00080000:3.0:1788837750.326482:0:5800:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e394dacb-3a10-4fe7-bf6d-0294b37a120d@0@lo t0 exp 0000000000000000 cur 130 last 0 00000020:00000080:3.0:1788837750.326510:0:5800:0:(genops.c:1385:class_connect()) connect: client e394dacb-3a10-4fe7-bf6d-0294b37a120d, cookie 0x2deb895b363e601c 00000100:00080000:3.0:1788837750.326672:0:5800:0:(import.c:65:import_set_state_nolock()) 000000005cdcaf7e : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837750.326727:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b8bf2d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+5:3270:x1875732254949504:12345-0@lo:250: Request processed in 279us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837750.326735:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788837750.326772:0:3270:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.154@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788837750.326780:0:3270:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.154@tcp: connect to target with instance 0 00000100:00080000:3.0:1788837750.326787:0:3270:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.154@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788837750.326791:0:3270:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788837750.326794:0:3270:0:(import.c:65:import_set_state_nolock()) 000000003010831e MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788837750.326797:0:3270:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788837750.326806:0:3270:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788837750.326810:0:3270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d097d7c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3270:1875732254949504:0@lo:250: 00000100:00080000:0.0:1788837750.333245:0:5804:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1788837750.367655:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788837750.367868:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788837750.367873:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788837750.369147:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788837750.369163:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788837750.369643:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788837750.369649:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788837750.370533:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788837750.370755:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788837750.370760:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788837750.371495:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788837750.371503:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788837750.432614:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788837750.432860:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788837750.432866:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788837750.440048:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788837750.440065:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788837750.441077:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788837750.441830:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788837750.441840:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788837750.445180:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788837750.445194:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788837750.447017:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788837750.447313:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788837750.447321:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788837750.449131:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788837750.449142:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788837750.450059:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788837750.450481:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788837750.450487:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788837750.451383:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788837750.451392:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788837750.484917:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788837750.485187:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788837750.485193:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788837750.487367:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788837750.487383:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788837750.490952:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788837750.490981:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788837750.497623:0:5789:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788837750.497652:0:5789:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788837750.497659:0:5789:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788837750.497842:0:5789:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788837750.497883:0:5789:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.154@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1788837750.497888:0:5789:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788837750.497889:0:5789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788837750.497891:0:5789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788837750.497892:0:5789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788837750.497893:0:5789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788837750.497894:0:5789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788837750.497896:0:5789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788837750.497897:0:5789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788837750.497899:0:5789:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788837750.497901:0:5789:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788837750.497902:0:5789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788837750.497903:0:5789:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788837750.497905:0:5789:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1788837750.497908:0:5789:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788837750.497909:0:5789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788837750.497910:0:5789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788837750.497911:0:5789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788837750.497912:0:5789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788837750.497913:0:5789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788837750.497914:0:5789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788837750.497915:0:5789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788837750.497916:0:5789:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788837750.497916:0:5789:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788837750.497917:0:5789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788837750.497918:0:5789:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788837750.497944:0:5789:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788837750.497960:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001433f014 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254949632:0@lo:253: 00000100:00100000:1.0:1788837750.498030:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837750.498088:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a1f90c09 going to sleep for 11 seconds 00000100:00100000:2.0:1788837750.498401:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254949632 00000100:00100000:2.0:1788837750.498410:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254949632 00000100:00100000:2.0:1788837750.498468:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788837750.498482:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e814158 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+5:5789:x1875732254949632:12345-0@lo:253: 20000000:01000000:2.0:1788837750.498528:0:5803:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788837750.498531:0:5803:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788837750.499177:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788837750.499263:0:5803:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788837750.499579:0:5803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788837750.503039:0:5825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788837750.505916:0:5803:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788837750.505923:0:5803:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788837750.505930:0:5803:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788837750.505932:0:5803:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788837750.505949:0:5803:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1788837750.506592:0:5803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788837750.506875:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1788837750.506892:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788837750.506952:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788837750.507002:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788837750.507039:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1788837750.507133:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1788837750.507143:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1788837750.507192:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1788837750.507475:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1788837750.507517:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1788837750.507527:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1788837750.507562:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1788837750.507630:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1788837750.507666:0:5803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788837750.507672:0:5803:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1788837750.507768:0:5803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788837750.507957:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1788837750.507969:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788837750.508004:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1788837750.508054:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1788837750.508095:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1788837750.508104:0:5803:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1788837750.508163:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1788837750.508171:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788837750.508314:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1788837750.508349:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1788837750.508376:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1788837750.508386:0:5803:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1788837750.508454:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1788837750.508462:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1788837750.508487:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1788837750.508513:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1788837750.508671:0:5803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1788837750.508789:0:5803:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788837750.508802:0:5803:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788837750.509160:0:5826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788837750.509449:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788837750.509469:0:5803:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.154@tcp for mdt 20000000:01000000:1.0:1788837750.509471:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.154@tcp (null) (null) (null) 00000040:00080000:1.0:1788837750.509497:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788837750.509503:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788837750.509525:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788837750.509531:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.154@tcp (null) (null) 00000040:00080000:1.0:1788837750.509588:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788837750.509598:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788837750.509627:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788837750.509654:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788837750.509770:0:5803:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788837750.509774:0:5803:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788837750.509778:0:5803:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788837750.509785:0:5803:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788837750.510050:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1788837750.510141:0:5803:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788837750.524857:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788837750.524954:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1788837750.525735:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1788837750.525774:0:5803:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788837750.525778:0:5803:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788837750.525781:0:5803:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788837750.525796:0:5803:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788837750.525799:0:5803:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788837750.525839:0:5803:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788837750.525841:0:5803:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788837750.526709:0:5828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1788837750.527099:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1788837750.527147:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1788837750.527659:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:1.0:1788837750.527686:0:5803:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788837750.527689:0:5803:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788837750.528584:0:5829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1788837750.529163:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1788837750.529334:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1788837750.529370:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1788837750.529381:0:5803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788837750.529383:0:5803:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:1.0:1788837750.529391:0:5803:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788837750.529411:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a5238e7f/0x2deb895b363e6023 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.529428:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a5238e7f/0x2deb895b363e6023 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.529437:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a5238e7f/0x2deb895b363e6023 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.529443:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a5238e7f/0x2deb895b363e6023 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.529448:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a5238e7f/0x2deb895b363e6023 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.529454:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a5238e7f/0x2deb895b363e6023 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.529460:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a5238e7f already unused, calling callback (00000000714d99b3) 00010000:00010000:1.0:1788837750.529463:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a5238e7f/0x2deb895b363e6023 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.529470:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a5238e7f/0x2deb895b363e6023 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.529491:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a5238e7f/0x2deb895b363e6023 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.529498:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a5238e7f/0x2deb895b363e6023 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.529503:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a5238e7f/0x2deb895b363e6023 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788837750.529518:0:5803:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788837750.767333:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e814158 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+5:5789:x1875732254949632:12345-0@lo:253: Request processed in 268844us (269294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837750.767353:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788837750.767462:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001433f014 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254949632:0@lo:253: 10000000:01000000:1.0:1788837750.767477:0:5789:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788837750.767481:0:5789:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788837750.767483:0:5789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788837750.767484:0:5789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788837750.767485:0:5789:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1788837750.767486:0:5789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788837750.767487:0:5789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788837750.767488:0:5789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788837750.767490:0:5789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788837750.767491:0:5789:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788837750.767492:0:5789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788837750.767494:0:5789:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788837750.767512:0:5789:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f5f56617 from lustre-MDT0000 10000000:01000000:1.0:1788837750.767539:0:5789:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788837750.767542:0:5789:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788837750.767546:0:5789:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff97a448f399b8 10000000:01000000:1.0:1788837750.767550:0:5789:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788837750.767557:0:5789:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97a448f399b8 from 1 10000000:01000000:1.0:1788837750.767570:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788837750.767605:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 00000000a5238e7f/0x2deb895b363e602a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.767632:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 00000000a5238e7f/0x2deb895b363e602a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.767641:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 00000000a5238e7f/0x2deb895b363e602a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837750.767658:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001433f014 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254949760:0@lo:101: 00000100:00100000:1.0:1788837750.767695:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837750.767837:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254949760 00000100:00100000:0.0:1788837750.767845:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254949760 00000100:00100000:0.0:1788837750.767897:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788837750.767905:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc7782d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+5:5789:x1875732254949760:12345-0@lo:101: 00010000:00010000:0.0:1788837750.767917:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837750.767931:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000096fa8f93/0x2deb895b363e6031 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e602a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837750.767965:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000096fa8f93/0x2deb895b363e6031 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e602a expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837750.767974:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000096fa8f93/0x2deb895b363e6031 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e602a expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837750.767982:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000096fa8f93, rc 0) 00000100:00100000:0.0:1788837750.768007:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc7782d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+6:5789:x1875732254949760:12345-0@lo:101: Request processed in 103us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837750.768013:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788837750.768066:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b7f9f28b going to sleep for 11 seconds 00000100:00100000:1.0:1788837750.768079:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001433f014 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254949760:0@lo:101: 00010000:00010000:1.0:1788837750.768090:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 00000000a5238e7f/0x2deb895b363e602a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6031 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.768099:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 00000000a5238e7f/0x2deb895b363e602a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e6031 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837750.768144:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001433f014 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254949888:0@lo:501: 00000100:00100000:1.0:1788837750.768169:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837750.768188:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b7f9f28b going to sleep for 11 seconds 00000100:00100000:3.0:1788837750.768307:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254949888 00000100:00100000:3.0:1788837750.768313:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254949888 00000100:00100000:3.0:1788837750.768347:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788837750.768353:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8bfc87f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+6:5789:x1875732254949888:12345-0@lo:501: 00000100:00100000:3.0:1788837750.768588:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8bfc87f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+6:5789:x1875732254949888:12345-0@lo:501: Request processed in 235us (418us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788837750.768595:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788837750.768684:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001433f014 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254949888:0@lo:501: 10000000:01000000:1.0:1788837750.768715:0:5789:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788837750.768724:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 00000000a5238e7f/0x2deb895b363e602a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6031 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.768732:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 00000000a5238e7f/0x2deb895b363e602a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6031 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837750.768877:0:5789:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97a448c63800 10000000:01000000:1.0:1788837750.768882:0:5789:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788837750.768886:0:5789:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff97a448c63800 10000000:01000000:1.0:1788837750.768888:0:5789:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788837750.768891:0:5789:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff97a448c63800 from 1 10000000:01000000:1.0:1788837750.768893:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788837750.768910:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 00000000da7763c0/0x2deb895b363e6038 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.768918:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 00000000da7763c0/0x2deb895b363e6038 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.768924:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 00000000da7763c0/0x2deb895b363e6038 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837750.768936:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001433f014 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254950016:0@lo:101: 00000100:00100000:1.0:1788837750.768963:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837750.769037:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b7f9f28b going to sleep for 11 seconds 00000100:00100000:3.0:1788837750.769135:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254950016 00000100:00100000:3.0:1788837750.769140:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254950016 00000100:00100000:3.0:1788837750.769233:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788837750.769240:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c846d79d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+6:5789:x1875732254950016:12345-0@lo:101: 00010000:00010000:3.0:1788837750.769248:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837750.769258:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ddd15f6f/0x2deb895b363e603f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e6038 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.769272:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ddd15f6f/0x2deb895b363e603f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e6038 expref: 7 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.769279:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ddd15f6f/0x2deb895b363e603f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e6038 expref: 7 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.769287:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ddd15f6f, rc 0) 00000100:00100000:3.0:1788837750.769363:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c846d79d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+7:5789:x1875732254950016:12345-0@lo:101: Request processed in 124us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837750.769369:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788837750.769482:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001433f014 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254950016:0@lo:101: 00010000:00010000:2.0:1788837750.769494:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 00000000da7763c0/0x2deb895b363e6038 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e603f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837750.769501:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 00000000da7763c0/0x2deb895b363e6038 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e603f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837750.769514:0:5789:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788837750.769574:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 00000000da7763c0/0x2deb895b363e6038 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e603f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837750.769582:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 00000000da7763c0/0x2deb895b363e6038 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e603f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837750.769589:0:5789:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788837750.769593:0:5789:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788837750.769598:0:5789:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff97a448c63800 10000000:01000000:2.0:1788837750.769601:0:5789:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788837750.769604:0:5789:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788837750.769606:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788837750.769635:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 00000000b1920b17/0x2deb895b363e6046 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837750.769642:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 00000000b1920b17/0x2deb895b363e6046 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837750.769655:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 00000000b1920b17/0x2deb895b363e6046 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837750.769668:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f19515a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254950144:0@lo:101: 00000100:00100000:2.0:1788837750.769717:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837750.769755:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c24edb79 going to sleep for 11 seconds 00000100:00100000:1.0:1788837750.769813:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254950144 00000100:00100000:1.0:1788837750.769817:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254950144 00000100:00100000:1.0:1788837750.769848:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788837750.769853:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003bb0feac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+7:5789:x1875732254950144:12345-0@lo:101: 00010000:00010000:1.0:1788837750.769860:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837750.769868:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000af107bd2/0x2deb895b363e604d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e6046 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.769882:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000af107bd2/0x2deb895b363e604d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e6046 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.769901:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000af107bd2/0x2deb895b363e604d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e6046 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.769907:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000af107bd2, rc 0) 00000100:00100000:1.0:1788837750.769938:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003bb0feac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+8:5789:x1875732254950144:12345-0@lo:101: Request processed in 85us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837750.769945:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788837750.769976:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f19515a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254950144:0@lo:101: 00010000:00010000:1.0:1788837750.769985:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 00000000b1920b17/0x2deb895b363e6046 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e604d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.769991:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 00000000b1920b17/0x2deb895b363e6046 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e604d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837750.770029:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000067b1cb0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254950272:0@lo:501: 00000100:00100000:1.0:1788837750.770052:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837750.770063:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e376f219 going to sleep for 11 seconds 00000100:00100000:1.0:1788837750.770076:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254950272 00000100:00100000:1.0:1788837750.770079:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254950272 00000100:00100000:1.0:1788837750.770096:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788837750.770100:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008791815a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+8:5789:x1875732254950272:12345-0@lo:501: 00000100:00100000:1.0:1788837750.770328:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008791815a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+9:5789:x1875732254950272:12345-0@lo:501: Request processed in 228us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837750.770335:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788837750.770364:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000067b1cb0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254950272:0@lo:501: 00000100:00100000:1.0:1788837750.770388:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000067b1cb0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254950400:0@lo:503: 00000100:00100000:1.0:1788837750.770426:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837750.770438:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e376f219 going to sleep for 11 seconds 00000100:00100000:1.0:1788837750.770450:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254950400 00000100:00100000:1.0:1788837750.770453:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254950400 00000100:00100000:1.0:1788837750.770468:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788837750.770473:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f26a616 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+9:5789:x1875732254950400:12345-0@lo:503: 00000100:00100000:1.0:1788837750.770624:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f26a616 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+9:5789:x1875732254950400:12345-0@lo:503: Request processed in 150us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837750.770630:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788837750.770667:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000067b1cb0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254950400:0@lo:503: 00000100:00100000:0.0:1788837750.771417:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066aa5ffd pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5831:1875732254950528:0@lo:502: 00000100:00100000:0.0:1788837750.771461:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837750.771531:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 0000000044ffaf34 going to sleep for 11 seconds 00000100:00100000:1.0:1788837750.771576:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254950528 00000100:00100000:1.0:1788837750.771581:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254950528 00000100:00100000:1.0:1788837750.771649:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788837750.771656:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb77b99c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+9:5831:x1875732254950528:12345-0@lo:502: 00000100:00100000:1.0:1788837750.771838:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb77b99c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+9:5831:x1875732254950528:12345-0@lo:502: Request processed in 182us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837750.771845:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788837750.771913:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066aa5ffd pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5831:1875732254950528:0@lo:502: 00000020:01000000:0.0:1788837750.771939:0:5831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837750.771952:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837750.771954:0:5831:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788837750.771960:0:5831:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788837750.771963:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788837750.771983:0:5831:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000009039e59f) 00000020:00000080:0.0:1788837750.772000:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788837750.772006:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788837750.772102:0:5831:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788837750.772109:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2deb895b363e605b 00000020:00000080:0.0:1788837750.772373:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788837750.772378:0:5831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837750.772382:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837750.772383:0:5831:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788837750.772393:0:5831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837750.772397:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837750.772398:0:5831:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788837750.772402:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788837750.772409:0:5831:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000065052895) 00000020:00000080:0.0:1788837750.772420:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788837750.772424:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788837750.772426:0:5831:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788837750.772429:0:5831:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788837750.772435:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788837750.772498:0:5831:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f5f56617 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788837750.772511:0:5831:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000d4d2ad75) 00000020:00000080:0.0:1788837750.772519:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788837750.772596:0:5831:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788837750.772603:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2deb895b363e6070 00000020:00000080:0.0:1788837750.772690:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788837750.772697:0:5831:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788837750.772701:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2deb895b363e6077 00080000:01000000:0.0:1788837750.772706:0:5831:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788837750.772709:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2deb895b363e607e 00080000:10000000:0.0:1788837750.773095:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1788837750.773342:0:5831:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1788837750.777809:0:5831:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788837750.862541:0:5831:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788837750.864252:0:5831:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788837750.870433:0:5831:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788837750.871507:0:5831:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788837750.969022:0:5831:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000009f5b2273) 00000020:00000080:3.0:1788837750.969046:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788837750.969121:0:5831:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788837750.969131:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2deb895b363e608c 00000020:00000080:3.0:1788837750.975422:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788837750.980119:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788837751.048104:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788837751.098742:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788837751.151255:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788837751.205036:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788837751.260068:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1788837751.302538:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2deb895b363e6093 00000020:00000080:3.0:1788837751.303168:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788837751.303179:0:5831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837751.303185:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837751.303188:0:5831:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788837751.303191:0:5831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788837751.303196:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837751.303198:0:5831:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788837751.303225:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788837751.303260:0:5831:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788837751.303274:0:5831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837751.303277:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837751.303279:0:5831:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788837751.303281:0:5831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788837751.303284:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837751.303285:0:5831:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788837751.303288:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788837751.303290:0:5831:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788837751.303443:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008fa6c82f pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5831:1875732254950656:0@lo:502: 00000100:00100000:3.0:1788837751.303529:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837751.303592:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 0000000070c3963e going to sleep for 11 seconds 00000100:00100000:0.0:1788837751.303654:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254950656 00000100:00100000:0.0:1788837751.303670:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254950656 00000100:00100000:0.0:1788837751.303715:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788837751.303722:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004042dc70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+9:5831:x1875732254950656:12345-0@lo:502: 00000100:00100000:0.0:1788837751.304029:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004042dc70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+9:5831:x1875732254950656:12345-0@lo:502: Request processed in 306us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837751.304037:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788837751.304289:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008fa6c82f pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5831:1875732254950656:0@lo:502: 00000020:01000000:3.0:1788837751.304316:0:5831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837751.304321:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837751.304323:0:5831:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788837751.304326:0:5831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1788837751.304531:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1788837751.304561:0:5789:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788837751.304579:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 00000000b1920b17/0x2deb895b363e6046 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e604d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.304590:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 00000000b1920b17/0x2deb895b363e6046 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e604d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837751.304598:0:5789:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97a448c63800 from 1 10000000:01000000:1.0:1788837751.304608:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788837751.304635:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 0000000079427997/0x2deb895b363e609a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.304643:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 0000000079427997/0x2deb895b363e609a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.304651:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 0000000079427997/0x2deb895b363e609a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837751.304674:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000067b1cb0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254950784:0@lo:101: 00000100:00100000:1.0:1788837751.304714:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837751.304755:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 0000000040881ccb going to sleep for 11 seconds 00000100:00100000:3.0:1788837751.304894:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254950784 00000100:00100000:3.0:1788837751.304900:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254950784 00000100:00100000:3.0:1788837751.304936:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788837751.304943:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000416bb9ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+9:5789:x1875732254950784:12345-0@lo:101: 00010000:00010000:3.0:1788837751.304952:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837751.304968:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005fb4385f/0x2deb895b363e60a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e609a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837751.304987:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005fb4385f/0x2deb895b363e60a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e609a expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837751.304997:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005fb4385f/0x2deb895b363e60a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e609a expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837751.305004:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005fb4385f, rc 0) 00000100:00100000:3.0:1788837751.305035:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000416bb9ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+10:5789:x1875732254950784:12345-0@lo:101: Request processed in 92us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837751.305041:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788837751.305074:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000067b1cb0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254950784:0@lo:101: 00010000:00010000:3.0:1788837751.305086:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 0000000079427997/0x2deb895b363e609a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e60a1 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837751.305093:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 0000000079427997/0x2deb895b363e609a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e60a1 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837751.305915:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008fa6c82f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254950912:0@lo:256: 00000100:00100000:3.0:1788837751.305975:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837751.306042:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 000000001dba9fd6 going to sleep for 11 seconds 00000100:00100000:1.0:1788837751.306329:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254950912 00000100:00100000:1.0:1788837751.306410:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254950912 00000100:00100000:1.0:1788837751.306486:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788837751.306495:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000555ab228 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+10:5789:x1875732254950912:12345-0@lo:256: 20000000:01000000:1.0:1788837751.306512:0:5802:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788837751.306518:0:5802:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788837751.306607:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000555ab228 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+10:5789:x1875732254950912:12345-0@lo:256: Request processed in 113us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837751.306615:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788837751.306695:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008fa6c82f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254950912:0@lo:256: 10000000:01000000:0.0:1788837751.307315:0:5789:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788837751.307356:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 0000000079427997/0x2deb895b363e609a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e60a1 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.307369:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 0000000079427997/0x2deb895b363e609a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e60a1 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837751.307378:0:5789:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a448c63800 from 1 10000000:01000000:0.0:1788837751.307381:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788837751.307413:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 00000000f60e47fd/0x2deb895b363e60a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.307420:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 00000000f60e47fd/0x2deb895b363e60a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.307428:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 00000000f60e47fd/0x2deb895b363e60a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837751.307444:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066aa5ffd pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254951040:0@lo:101: 00000100:00100000:0.0:1788837751.307482:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837751.308046:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 000000004c5c20cf going to sleep for 11 seconds 00000100:00100000:3.0:1788837751.308089:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254951040 00000100:00100000:3.0:1788837751.308096:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254951040 00000100:00100000:2.0:1788837751.308149:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788837751.308158:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041abff12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+10:5789:x1875732254951040:12345-0@lo:101: 00010000:00010000:2.0:1788837751.308169:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837751.308184:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000000a6b0be/0x2deb895b363e60af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e60a8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837751.308221:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000000a6b0be/0x2deb895b363e60af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e60a8 expref: 11 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837751.308231:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000000a6b0be/0x2deb895b363e60af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e60a8 expref: 11 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837751.308240:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000000a6b0be, rc 0) 00000100:00100000:2.0:1788837751.308287:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041abff12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+11:5789:x1875732254951040:12345-0@lo:101: Request processed in 130us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837751.308294:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788837751.308477:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066aa5ffd pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254951040:0@lo:101: 00010000:00010000:0.0:1788837751.308489:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 00000000f60e47fd/0x2deb895b363e60a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e60af expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.308498:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 00000000f60e47fd/0x2deb895b363e60a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e60af expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837751.308570:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066aa5ffd pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254951168:0@lo:501: 00000100:00100000:0.0:1788837751.308598:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837751.308630:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 000000004c5c20cf going to sleep for 11 seconds 00000100:00100000:2.0:1788837751.308812:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254951168 00000100:00100000:2.0:1788837751.308816:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254951168 00000100:00100000:2.0:1788837751.308853:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788837751.308858:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab64ca68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+11:5789:x1875732254951168:12345-0@lo:501: 00000100:00100000:2.0:1788837751.309880:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab64ca68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+11:5789:x1875732254951168:12345-0@lo:501: Request processed in 1018us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837751.309892:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788837751.310143:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066aa5ffd pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254951168:0@lo:501: 00000100:00100000:0.0:1788837751.310190:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066aa5ffd pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254951296:0@lo:503: 00000100:00100000:0.0:1788837751.310469:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837751.310505:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 000000004c5c20cf going to sleep for 11 seconds 00000100:00100000:1.0:1788837751.310577:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254951296 00000100:00100000:1.0:1788837751.310584:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254951296 00000100:00100000:1.0:1788837751.310628:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788837751.310637:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db08a2dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+11:5789:x1875732254951296:12345-0@lo:503: 00000040:00080000:1.0:1788837751.310690:0:5800:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788837751.310877:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db08a2dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+11:5789:x1875732254951296:12345-0@lo:503: Request processed in 241us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837751.310894:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788837751.310977:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066aa5ffd pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254951296:0@lo:503: 00000040:00080000:0.0:1788837751.312114:0:5835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788837751.312433:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788837751.312450:0:5789:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788837751.312471:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 00000000f60e47fd/0x2deb895b363e60a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e60af expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.312485:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 00000000f60e47fd/0x2deb895b363e60a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e60af expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837751.312527:0:5789:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788837751.312530:0:5789:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97a448c63800 10000000:01000000:1.0:1788837751.312533:0:5789:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97a448c63800 10000000:01000000:1.0:1788837751.312537:0:5789:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788837751.312544:0:5789:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97a448c63800 from 1 10000000:01000000:1.0:1788837751.312547:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788837751.312589:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 000000006099f06c/0x2deb895b363e60b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.312597:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 000000006099f06c/0x2deb895b363e60b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.312607:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 000000006099f06c/0x2deb895b363e60b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837751.312626:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c5bee885 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254951424:0@lo:101: 00000100:00100000:1.0:1788837751.312691:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837751.312729:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d1d1570b going to sleep for 11 seconds 00000100:00100000:3.0:1788837751.312905:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254951424 00000100:00100000:3.0:1788837751.312913:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254951424 00000100:00100000:3.0:1788837751.312955:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788837751.312963:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bfb201fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+11:5789:x1875732254951424:12345-0@lo:101: 00010000:00010000:3.0:1788837751.312989:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837751.312999:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000ffb1111/0x2deb895b363e60bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e60b6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837751.313021:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000ffb1111/0x2deb895b363e60bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e60b6 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837751.313030:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000ffb1111/0x2deb895b363e60bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e60b6 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837751.313039:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000ffb1111, rc 0) 00000100:00100000:3.0:1788837751.313071:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bfb201fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:5789:x1875732254951424:12345-0@lo:101: Request processed in 109us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837751.313078:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788837751.313163:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c5bee885 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254951424:0@lo:101: 00010000:00010000:1.0:1788837751.313177:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 000000006099f06c/0x2deb895b363e60b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e60bd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.313192:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 000000006099f06c/0x2deb895b363e60b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e60bd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837751.313264:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c5bee885 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254951552:0@lo:501: 00000100:00100000:1.0:1788837751.313291:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837751.313305:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d1d1570b going to sleep for 11 seconds 00000100:00100000:3.0:1788837751.313433:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254951552 00000100:00100000:3.0:1788837751.313438:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254951552 00000100:00100000:3.0:1788837751.313458:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788837751.313464:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc3b9f06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:5789:x1875732254951552:12345-0@lo:501: 00000100:00100000:3.0:1788837751.313940:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc3b9f06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:5789:x1875732254951552:12345-0@lo:501: Request processed in 475us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837751.313949:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788837751.314124:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c5bee885 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254951552:0@lo:501: 00000100:00100000:1.0:1788837751.314157:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c5bee885 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254951680:0@lo:503: 00000100:00100000:1.0:1788837751.314421:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837751.314484:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d1d1570b going to sleep for 11 seconds 00000100:00100000:2.0:1788837751.314520:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254951680 00000100:00100000:2.0:1788837751.314525:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254951680 00000100:00100000:2.0:1788837751.314598:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788837751.314606:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c09fe47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:5789:x1875732254951680:12345-0@lo:503: 00000100:00100000:2.0:1788837751.315080:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c09fe47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:5789:x1875732254951680:12345-0@lo:503: Request processed in 473us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837751.315089:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788837751.315166:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c5bee885 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254951680:0@lo:503: 00000100:00100000:3.0:1788837751.315593:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b24d6a24 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5836:1875732254951808:0@lo:502: 00000100:00100000:3.0:1788837751.315633:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837751.316171:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 000000007b4b8c27 going to sleep for 11 seconds 00000100:00100000:1.0:1788837751.316199:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254951808 00000100:00100000:1.0:1788837751.316226:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254951808 00000100:00100000:2.0:1788837751.316284:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788837751.316292:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b93dfc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:5836:x1875732254951808:12345-0@lo:502: 00000100:00100000:2.0:1788837751.316920:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b93dfc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:5836:x1875732254951808:12345-0@lo:502: Request processed in 627us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837751.316929:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788837751.317002:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b24d6a24 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5836:1875732254951808:0@lo:502: 00000020:01000004:3.0:1788837751.317073:0:5836:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788837751.317105:0:5836:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000da620512) 00000020:00000080:3.0:1788837751.317126:0:5836:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788837751.317229:0:5836:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f5f56617 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788837751.317233:0:5836:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000f5f56617 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788837751.317237:0:5836:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000f5f56617 4 00010000:00080000:3.0:1788837751.317267:0:5836:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000719ab154@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:3.0:1788837751.319654:0:5836:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788837751.320136:0:5836:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788837751.320172:0:5836:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788837751.320185:0:5836:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2deb895b363e60cb 00000100:00080000:3.0:1788837751.320196:0:5836:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788837751.320230:0:5836:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000719ab154 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788837751.320280:0:5836:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b24d6a24 x1875732254951936/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788837751.320300:0:5836:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788837751.320437:0:3270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b24d6a24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3270:1875732254951936:0@lo:38: 00000100:00100000:1.0:1788837751.320506:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837751.320707:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254951936 00000100:00100000:3.0:1788837751.320715:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254951936 00000100:00100000:3.0:1788837751.320818:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788837751.320825:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004de4e94e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3270:x1875732254951936:12345-0@lo:38: 00000100:00100000:3.0:1788837751.320881:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004de4e94e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3270:x1875732254951936:12345-0@lo:38: Request processed in 55us (375us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788837751.320889:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788837751.320939:0:3270:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788837751.320951:0:3270:0:(import.c:65:import_set_state_nolock()) 00000000719ab154 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788837751.320956:0:3270:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788837751.320959:0:3270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b24d6a24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3270:1875732254951936:0@lo:38: 00000100:00100000:3.0:1788837751.328954:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b24d6a24 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5836:1875732254952064:0@lo:502: 00000100:00100000:3.0:1788837751.329045:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837751.329165:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c8a6da7c going to sleep for 11 seconds 00000100:00100000:0.0:1788837751.329239:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254952064 00000100:00100000:0.0:1788837751.329246:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254952064 00000100:00100000:0.0:1788837751.329293:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788837751.329301:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076c74451 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:5836:x1875732254952064:12345-0@lo:502: 00000100:00100000:0.0:1788837751.329539:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076c74451 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:5836:x1875732254952064:12345-0@lo:502: Request processed in 239us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837751.329547:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788837751.330666:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b24d6a24 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5836:1875732254952064:0@lo:502: 00010000:00010000:3.0:1788837751.330797:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788837751.330809:0:5836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1788837751.331263:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788837751.331284:0:5789:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788837751.331298:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 000000006099f06c/0x2deb895b363e60b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e60bd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.331308:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 000000006099f06c/0x2deb895b363e60b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e60bd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788837751.331566:0:5789:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788837751.331569:0:5789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788837751.331570:0:5789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837751.331571:0:5789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837751.331573:0:5789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837751.331574:0:5789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837751.331575:0:5789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788837751.331582:0:5789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788837751.331583:0:5789:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788837751.331585:0:5789:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788837751.331586:0:5789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837751.331587:0:5789:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788837751.331591:0:5789:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788837751.331594:0:5789:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788837751.331595:0:5789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788837751.331596:0:5789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837751.331597:0:5789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837751.331598:0:5789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837751.331599:0:5789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837751.331600:0:5789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788837751.331601:0:5789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788837751.331602:0:5789:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788837751.331603:0:5789:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788837751.331604:0:5789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837751.331604:0:5789:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788837751.331626:0:5789:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788837751.331641:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066aa5ffd pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254952192:0@lo:253: 00000100:00100000:0.0:1788837751.331710:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837751.331748:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 0000000003ad0591 going to sleep for 11 seconds 00000100:00100000:2.0:1788837751.331794:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254952192 00000100:00100000:2.0:1788837751.331801:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254952192 00000100:00100000:2.0:1788837751.332195:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788837751.332228:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5812474 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:5789:x1875732254952192:12345-0@lo:253: 20000000:01000000:2.0:1788837751.332260:0:5803:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788837751.332277:0:5803:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788837751.385729:0:5803:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788837751.385758:0:5803:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788837751.385812:0:5824:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788837751.385817:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788837751.385839:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000cea6300e/0x2deb895b363e60d2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.385858:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005fb4385f/0x2deb895b363e60a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e609a expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.385867:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000cea6300e/0x2deb895b363e60d2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.385909:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005fb4385f/0x2deb895b363e60a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e609a expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.385944:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005fb4385f/0x2deb895b363e60a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e609a expref: 12 pid: 5803 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837751.385958:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001dc7ef98 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5824:1875732254952320:0@lo:104: 00000100:00100000:0.0:1788837751.386026:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837751.386085:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 000000004f1c987e going to sleep for 11 seconds 00000100:00100000:2.0:1788837751.386493:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254952320 00000100:00100000:2.0:1788837751.386502:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254952320 00000100:00100000:2.0:1788837751.386562:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788837751.386578:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052b0e859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+3:5824:x1875732254952320:12345-0@lo:104: 00010000:00010000:2.0:1788837751.386590:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: 0000000079427997/0x2deb895b363e609a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e60a1 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837751.386643:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788837751.386648:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052b0e859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+3:5824:x1875732254952320:12345-0@lo:104: Request processed in 72us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837751.386655:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837751.386773:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001dc7ef98 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5824:1875732254952320:0@lo:104: 00010000:00010000:0.0:1788837751.386793:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000cea6300e/0x2deb895b363e60d2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.387442:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837751.387449:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: 0000000079427997/0x2deb895b363e609a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e60a1 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.387458:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000079427997 already unused, calling callback (00000000b9372e9f) 10000000:00010000:0.0:1788837751.387461:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: 0000000079427997/0x2deb895b363e609a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e60a1 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.387469:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: 0000000079427997/0x2deb895b363e609a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e60a1 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837751.387476:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: 0000000079427997/0x2deb895b363e609a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e60a1 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837751.387482:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788837751.387523:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: 0000000079427997/0x2deb895b363e609a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e60a1 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.387530:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837751.387569:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: 0000000079427997/0x2deb895b363e609a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e60a1 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.387576:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: 0000000079427997/0x2deb895b363e609a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e60a1 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.387594:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837751.387596:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837751.387597:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837751.387651:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001dc7ef98 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732254952448:0@lo:103: 00000100:00100000:0.0:1788837751.387690:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837751.387777:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254952448 00000100:00100000:0.0:1788837751.387783:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254952448 00010000:00010000:0.0:1788837751.387801:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005fb4385f/0x2deb895b363e60a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e609a expref: 13 pid: 5803 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837751.387826:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837751.387833:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b83cc56a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:3272:x1875732254952448:12345-0@lo:103: 00010000:00010000:0.0:1788837751.387843:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837751.387847:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005fb4385f/0x2deb895b363e60a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e609a expref: 13 pid: 5803 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.387856:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005fb4385f/0x2deb895b363e60a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e609a expref: 13 pid: 5803 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.387869:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005fb4385f/0x2deb895b363e60a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e609a expref: 13 pid: 5803 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.387881:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000cea6300e/0x2deb895b363e60d2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.387899:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cea6300e/0x2deb895b363e60d2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788837751.387911:0:5793:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002095110s 00010000:00010000:0.0:1788837751.387914:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000cea6300e/0x2deb895b363e60d2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.387919:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000cea6300e/0x2deb895b363e60d2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.387925:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000cea6300e/0x2deb895b363e60d2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.387930:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000cea6300e/0x2deb895b363e60d2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.387935:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cea6300e already unused, calling callback (00000000714d99b3) 00010000:00010000:0.0:1788837751.387937:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000cea6300e/0x2deb895b363e60d2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.387943:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000cea6300e/0x2deb895b363e60d2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.387955:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000cea6300e/0x2deb895b363e60d2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.387964:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837751.387993:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b83cc56a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:3272:x1875732254952448:12345-0@lo:103: Request processed in 161us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837751.388001:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837751.388037:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001dc7ef98 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732254952448:0@lo:103: 00010000:00010000:0.0:1788837751.388053:0:5824:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000cea6300e/0x2deb895b363e60d2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.388061:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000cea6300e/0x2deb895b363e60d2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.388067:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cea6300e/0x2deb895b363e60d2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837751.398192:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5812474 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+11:5789:x1875732254952192:12345-0@lo:253: Request processed in 65958us (66474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837751.398231:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788837751.398410:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066aa5ffd pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5789:1875732254952192:0@lo:253: 10000000:01000000:3.0:1788837751.398426:0:5789:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788837751.398429:0:5789:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788837751.398431:0:5789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788837751.398432:0:5789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788837751.398433:0:5789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788837751.398435:0:5789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788837751.398436:0:5789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788837751.398437:0:5789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788837751.398439:0:5789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788837751.398440:0:5789:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788837751.398442:0:5789:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788837751.398443:0:5789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788837751.398445:0:5789:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788837751.398458:0:5789:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788837751.407473:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788837751.407976:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788837751.408190:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788837751.408934:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788837751.409148:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788837751.409504:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788837751.414947:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788837751.415309:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788837751.418670:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788837751.419035:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788837751.419325:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788837751.419858:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1788837751.504641:0:5789:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788837751.575916:0:5789:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788837751.576194:0:5841:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788837751.576199:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788837751.576383:0:5842:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788837751.593704:0:5789:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788837751.595337:0:5789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788837751.596939:0:5789:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788837751.596959:0:5789:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788837751.599483:0:5789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788837751.606685:0:5789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788837751.607263:0:5789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788837751.607314:0:5789:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788837751.607647:0:5789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788837751.607852:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1788837751.615672:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788837751.615832:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788837751.616003:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788837751.616139:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788837751.616327:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788837751.616464:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788837751.616627:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788837751.616799:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788837751.616951:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788837751.617083:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788837751.617291:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788837751.617430:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788837751.617606:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788837751.617749:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788837751.617896:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788837751.628115:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788837751.628456:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788837751.628629:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788837751.628795:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788837751.628940:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788837751.629093:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788837751.629291:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788837751.629438:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788837751.629619:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788837751.629771:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788837751.629904:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788837751.630055:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788837751.630248:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788837751.630412:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788837751.637362:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788837751.637607:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788837751.637756:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788837751.637967:0:5789:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1788837751.706043:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1788837751.775127:0:5789:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788837751.775165:0:5789:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbcc281bd7988 00100000:10000000:0.0:1788837751.775173:0:5789:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000040:00080000:2.0:1788837751.777573:0:5842:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788837751.777668:0:5842:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788837751.777673:0:5842:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:01000004:1.0:1788837751.778790:0:5789:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788837751.778808:0:5789:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788837751.778824:0:5789:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1788837751.778841:0:5789:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1788837752.354307:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837753.380824:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837754.403371:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837755.430183:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837756.450346:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788837756.580895:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788837756.580907:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788837756.580910:0:37:0:(import.c:65:import_set_state_nolock()) 00000000719ab154 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788837756.580925:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000719ab154 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788837756.580948:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fb511c12 x1875732254952704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788837756.581001:0:3270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fb511c12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3270:1875732254952704:0@lo:38: 00000100:00100000:0.0:1788837756.581076:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837756.581333:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001dc7ef98 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732254952576:0@lo:400: 00000100:00100000:3.0:1788837756.581371:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837756.581675:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254952704 00000100:00100000:2.0:1788837756.585677:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254952704 00000100:00100000:2.0:1788837756.586633:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788837756.586642:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031142b0c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3270:x1875732254952704:12345-0@lo:38: 00010000:00080000:2.0:1788837756.586674:0:5810:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 136 last 0 00000020:00000080:2.0:1788837756.586790:0:5810:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2deb895b363e60d9 00000004:00100000:2.0:1788837756.586843:0:5810:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788837756.586984:0:5810:0:(import.c:65:import_set_state_nolock()) 0000000079f12aeb : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788837756.587082:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031142b0c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3270:x1875732254952704:12345-0@lo:38: Request processed in 439us (6006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837756.587090:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788837756.587296:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254952576 00000100:00100000:1.0:1788837756.587304:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254952576 00000100:00100000:1.0:1788837756.587343:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788837756.587350:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051b191f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+11:3273:x1875732254952576:12345-0@lo:400: 00000100:00100000:1.0:1788837756.587393:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051b191f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+11:3273:x1875732254952576:12345-0@lo:400: Request processed in 44us (6022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837756.587408:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788837756.587494:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001dc7ef98 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732254952576:0@lo:400: 00010000:00080000:0.0:1788837756.587788:0:3270:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000fb511c12 x1875732254952704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788837766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788837756.587817:0:3270:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788837756.587825:0:3270:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788837756.587830:0:3270:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788837756.587832:0:3270:0:(import.c:65:import_set_state_nolock()) 00000000719ab154 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788837756.587838:0:3270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fb511c12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3270:1875732254952704:0@lo:38: 00000001:02000400:0.0:1788837757.114497:0:6085:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788837757.474568:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788837758.117678:0:5805:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788837758.117687:0:5805:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97a448c63800 from 3 10000000:01000000:0.0:1788837758.117692:0:5805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788837758.117742:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 000000007b54dd6d/0x2deb895b363e60e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837758.117757:0:5805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 000000007b54dd6d/0x2deb895b363e60e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837758.117769:0:5805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 000000007b54dd6d/0x2deb895b363e60e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837758.117793:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fb511c12 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254952832:0@lo:101: 00000100:00100000:0.0:1788837758.117865:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837758.117927:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b8345859 going to sleep for 11 seconds 00000100:00100000:3.0:1788837758.118622:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254952832 00000100:00100000:3.0:1788837758.118632:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254952832 00000100:00100000:3.0:1788837758.118687:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788837758.118695:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001920af89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+11:5805:x1875732254952832:12345-0@lo:101: 00010000:00010000:3.0:1788837758.118711:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837758.118725:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b8415e95/0x2deb895b363e60e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e60e0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837758.118765:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b8415e95/0x2deb895b363e60e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e60e0 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837758.118776:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b8415e95/0x2deb895b363e60e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e60e0 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837758.118801:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b8415e95, rc 0) 00000100:00100000:3.0:1788837758.118854:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001920af89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:5805:x1875732254952832:12345-0@lo:101: Request processed in 160us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837758.118861:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788837758.118915:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fb511c12 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254952832:0@lo:101: 00010000:00010000:3.0:1788837758.118927:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 000000007b54dd6d/0x2deb895b363e60e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e60e7 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837758.118935:0:5805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 000000007b54dd6d/0x2deb895b363e60e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e60e7 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837758.118986:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b24d6a24 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254952960:0@lo:256: 00000100:00100000:3.0:1788837758.119019:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837758.119037:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set 000000008cd4a0da going to sleep for 11 seconds 00000100:00100000:3.0:1788837758.119050:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254952960 00000100:00100000:3.0:1788837758.119053:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254952960 00000100:00100000:3.0:1788837758.119075:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788837758.119081:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6ee52b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:5805:x1875732254952960:12345-0@lo:256: 20000000:01000000:3.0:1788837758.119096:0:5802:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788837758.119113:0:5802:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788837758.119117:0:5802:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788837758.119186:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6ee52b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:5805:x1875732254952960:12345-0@lo:256: Request processed in 105us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837758.119193:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788837758.119236:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b24d6a24 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254952960:0@lo:256: 10000000:01000000:3.0:1788837758.119276:0:5805:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788837758.119285:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 000000007b54dd6d/0x2deb895b363e60e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e60e7 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837758.119293:0:5805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 000000007b54dd6d/0x2deb895b363e60e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e60e7 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837758.509495:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837759.522605:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837760.555179:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837761.573734:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837761.716225:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000017a3d795 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732254953216:0@lo:400: 00000100:00100000:1.0:1788837761.716311:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837761.716415:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254953216 00000100:00100000:1.0:1788837761.716424:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254953216 00000100:00100000:1.0:1788837761.716484:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788837761.716494:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3675c92 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732254953216:12345-0@lo:400: 00000100:00100000:1.0:1788837761.716559:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3675c92 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732254953216:12345-0@lo:400: Request processed in 68us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837761.716566:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788837761.716606:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000017a3d795 x1875732254953216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837761.716620:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000017a3d795 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732254953216:0@lo:400: 00000100:00100000:3.0:1788837761.716725:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837761.716737:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009e374d15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732254953088:0@lo:400: 00000100:00100000:3.0:1788837761.716773:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837761.716806:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254953088 00000100:00100000:3.0:1788837761.716810:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254953088 00000100:00100000:3.0:1788837761.716851:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788837761.716858:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc7c7045 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:3273:x1875732254953088:12345-0@lo:400: 00000100:00100000:3.0:1788837761.716893:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc7c7045 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:3273:x1875732254953088:12345-0@lo:400: Request processed in 36us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837761.716899:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788837761.716935:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009e374d15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732254953088:0@lo:400: 00000020:00000080:0.0:1788837762.573881:0:6287:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd0a66c110 20000000:00000080:0.0:1788837762.573905:0:6287:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97a47c8f6c00 uarg=0000000000000000 20000000:01000000:0.0:1788837762.573943:0:6287:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788837762.573950:0:6287:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788837762.573963:0:6287:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788837762.575357:0:6287:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788837762.575372:0:6287:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788837762.584451:0:6287:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788837762.584737:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788837762.584811:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788837762.584866:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788837762.584885:0:6287:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788837762.584903:0:6287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000cea6300e/0x2deb895b363e60ee lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837762.584921:0:6287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000000a6b0be/0x2deb895b363e60af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e60a8 expref: 11 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837762.584929:0:6287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000cea6300e/0x2deb895b363e60ee lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837762.584970:0:6287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000000a6b0be/0x2deb895b363e60af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e60a8 expref: 11 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837762.584985:0:6287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000000a6b0be/0x2deb895b363e60af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e60a8 expref: 11 pid: 5800 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837762.584999:0:6287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000e7e426e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6287:1875732254953344:0@lo:104: 00000100:00100000:0.0:1788837762.586141:0:6287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837762.586376:0:6287:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ce336788 going to sleep for 11 seconds 00000100:00100000:2.0:1788837762.594598:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254953344 00000100:00100000:2.0:1788837762.594615:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254953344 00000100:00100000:2.0:1788837762.594682:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788837762.594691:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf977e30 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+3:6287:x1875732254953344:12345-0@lo:104: 00010000:00010000:2.0:1788837762.594710:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: 00000000f60e47fd/0x2deb895b363e60a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e60af expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837762.594813:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788837762.594819:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf977e30 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+3:6287:x1875732254953344:12345-0@lo:104: Request processed in 129us (8683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837762.594826:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788837762.594861:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837762.594867:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: 00000000f60e47fd/0x2deb895b363e60a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e60af expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837762.594874:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f60e47fd already unused, calling callback (00000000b9372e9f) 10000000:00010000:2.0:1788837762.594878:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: 00000000f60e47fd/0x2deb895b363e60a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e60af expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837762.594886:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: 00000000f60e47fd/0x2deb895b363e60a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e60af expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837762.594892:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: 00000000f60e47fd/0x2deb895b363e60a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e60af expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837762.594897:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788837762.594949:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: 00000000f60e47fd/0x2deb895b363e60a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e60af expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837762.594956:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788837762.594970:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: 00000000f60e47fd/0x2deb895b363e60a8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e60af expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837762.594975:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: 00000000f60e47fd/0x2deb895b363e60a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e60af expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837762.594993:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837762.594995:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837762.594996:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837762.595066:0:6287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000e7e426e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6287:1875732254953344:0@lo:104: 00010000:00010000:0.0:1788837762.595090:0:6287:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000cea6300e/0x2deb895b363e60ee lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837762.595152:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000019866e92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732254953472:0@lo:103: 00000100:00100000:1.0:1788837762.595194:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837762.595343:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254953472 00000100:00100000:0.0:1788837762.595355:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254953472 00010000:00010000:0.0:1788837762.595374:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000000a6b0be/0x2deb895b363e60af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e60a8 expref: 12 pid: 5800 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837762.595402:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788837762.595408:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017a3d795 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:3272:x1875732254953472:12345-0@lo:103: 00010000:00010000:0.0:1788837762.595418:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837762.595422:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000000a6b0be/0x2deb895b363e60af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e60a8 expref: 12 pid: 5800 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837762.595431:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000000a6b0be/0x2deb895b363e60af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e60a8 expref: 12 pid: 5800 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837762.595443:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000000a6b0be/0x2deb895b363e60af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e60a8 expref: 12 pid: 5800 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837762.595466:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000cea6300e/0x2deb895b363e60ee lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837762.595474:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cea6300e/0x2deb895b363e60ee lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837762.595487:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000cea6300e/0x2deb895b363e60ee lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837762.595493:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000cea6300e/0x2deb895b363e60ee lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837762.595499:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000cea6300e/0x2deb895b363e60ee lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837762.595504:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000cea6300e/0x2deb895b363e60ee lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837762.595516:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cea6300e already unused, calling callback (00000000714d99b3) 00010000:00010000:0.0:1788837762.595519:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000cea6300e/0x2deb895b363e60ee lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837762.595525:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000cea6300e/0x2deb895b363e60ee lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837762.595538:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000cea6300e/0x2deb895b363e60ee lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837762.595546:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837762.595575:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017a3d795 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+11:3272:x1875732254953472:12345-0@lo:103: Request processed in 168us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837762.595581:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788837762.595600:0:6287:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000cea6300e/0x2deb895b363e60ee lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837762.595607:0:6287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000cea6300e/0x2deb895b363e60ee lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837762.595611:0:6287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cea6300e/0x2deb895b363e60ee lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837762.599239:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000019866e92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732254953472:0@lo:103: 00010000:00010000:3.0:1788837762.599606:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837763.621621:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837764.642377:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837765.667199:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788837765.732028:0:5805:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788837765.732036:0:5805:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a448c63800 from 1 10000000:01000000:1.0:1788837765.732041:0:5805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788837765.732227:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 00000000762e7abd/0x2deb895b363e60f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837765.732239:0:5805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 00000000762e7abd/0x2deb895b363e60f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837765.732258:0:5805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 00000000762e7abd/0x2deb895b363e60f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837765.732292:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000956b48fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254953600:0@lo:101: 00000100:00100000:1.0:1788837765.732359:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837765.732780:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eff587b9 going to sleep for 11 seconds 00000100:00100000:0.0:1788837765.734187:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254953600 00000100:00100000:0.0:1788837765.734218:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254953600 00000100:00100000:0.0:1788837765.734291:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788837765.734300:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007fddeed5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+11:5805:x1875732254953600:12345-0@lo:101: 00010000:00010000:0.0:1788837765.734319:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837765.734345:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b428996c/0x2deb895b363e60fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e60f5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837765.734376:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b428996c/0x2deb895b363e60fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e60f5 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837765.734387:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b428996c/0x2deb895b363e60fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e60f5 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837765.734396:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b428996c, rc 0) 00000100:00100000:0.0:1788837765.734538:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007fddeed5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:5805:x1875732254953600:12345-0@lo:101: Request processed in 238us (2178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837765.734546:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788837765.734606:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000956b48fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254953600:0@lo:101: 00010000:00010000:0.0:1788837765.734623:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 00000000762e7abd/0x2deb895b363e60f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e60fc expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837765.734633:0:5805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 00000000762e7abd/0x2deb895b363e60f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e60fc expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837765.734703:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000e7e426e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254953728:0@lo:501: 00000100:00100000:0.0:1788837765.734736:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837765.735139:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254953728 00000100:00100000:1.0:1788837765.735146:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254953728 00000100:00100000:1.0:1788837765.735178:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788837765.735187:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008628e844 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:5805:x1875732254953728:12345-0@lo:501: 00000100:00100000:1.0:1788837765.735631:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008628e844 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:5805:x1875732254953728:12345-0@lo:501: Request processed in 445us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837765.735639:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788837765.736350:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6c0c5aa going to sleep for 11 seconds 00000100:00100000:0.0:1788837765.736378:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000e7e426e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254953728:0@lo:501: 00000100:00100000:0.0:1788837765.736425:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000e7e426e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254953856:0@lo:503: 00000100:00100000:0.0:1788837765.736476:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837765.736501:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6c0c5aa going to sleep for 11 seconds 00000100:00100000:0.0:1788837765.736519:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254953856 00000100:00100000:0.0:1788837765.736531:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254953856 00000100:00100000:0.0:1788837765.736573:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788837765.736581:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b55be8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:5805:x1875732254953856:12345-0@lo:503: 00000100:00100000:0.0:1788837765.739129:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b55be8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:5805:x1875732254953856:12345-0@lo:503: Request processed in 2542us (2648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837765.739144:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788837765.741628:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000e7e426e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254953856:0@lo:503: 00000100:00100000:2.0:1788837765.747071:0:6383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005fd24801 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6383:1875732254953984:0@lo:502: 00000100:00100000:2.0:1788837765.747173:0:6383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837765.747267:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254953984 00000100:00100000:1.0:1788837765.747285:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254953984 00000100:00100000:1.0:1788837765.747334:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788837765.747342:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050cbdd10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:6383:x1875732254953984:12345-0@lo:502: 00000100:00100000:2.0:1788837765.747588:0:6383:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d1d1570b going to sleep for 11 seconds 00000100:00100000:1.0:1788837765.753339:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050cbdd10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:6383:x1875732254953984:12345-0@lo:502: Request processed in 5988us (6157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837765.753356:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788837765.753395:0:6383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005fd24801 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6383:1875732254953984:0@lo:502: 00000020:01000000:2.0:1788837765.753444:0:6383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837765.753470:0:6383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837765.753473:0:6383:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788837765.753483:0:6383:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a448c63800 00000020:00000080:2.0:1788837765.753487:0:6383:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788837765.753548:0:6383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6383:1875732254954112:0@lo:502: 00000100:00100000:2.0:1788837765.753597:0:6383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837765.753639:0:6383:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4600c6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788837765.753707:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254954112 00000100:00100000:1.0:1788837765.753715:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254954112 00000100:00100000:1.0:1788837765.753759:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788837765.753767:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a520450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:6383:x1875732254954112:12345-0@lo:502: 00000100:00100000:1.0:1788837765.753953:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a520450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:6383:x1875732254954112:12345-0@lo:502: Request processed in 186us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837765.753967:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788837765.754421:0:6383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6383:1875732254954112:0@lo:502: 00000020:01000000:2.0:1788837765.754445:0:6383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837765.754468:0:6383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837765.754470:0:6383:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788837765.754475:0:6383:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788837765.757325:0:5805:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788837765.757365:0:5805:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788837765.757377:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441667400/0x2deb895b363e60f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e60fc expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837765.757390:0:5805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a441667400/0x2deb895b363e60f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e60fc expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837766.690956:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837766.818835:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732254954240:0@lo:400: 00000100:00100000:0.0:1788837766.818970:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837766.819063:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788837766.819070:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732254954368:0@lo:400: 00000100:00100000:0.0:1788837766.819101:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837766.819142:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254954240 00000100:00100000:0.0:1788837766.819414:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254954240 00000100:00100000:0.0:1788837766.819481:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788837766.819492:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a520c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:3273:x1875732254954240:12345-0@lo:400: 00000100:00100000:0.0:1788837766.819557:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a520c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:3273:x1875732254954240:12345-0@lo:400: Request processed in 66us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837766.819565:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788837766.819611:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254954368 00000100:00100000:0.0:1788837766.819616:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254954368 00000100:00100000:0.0:1788837766.819665:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788837766.819672:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732254954368:12345-0@lo:400: 00000100:00100000:0.0:1788837766.819710:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732254954368:12345-0@lo:400: Request processed in 38us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837766.819717:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788837766.819767:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97a46f4d1c00 x1875732254954368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837766.819784:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732254954368:0@lo:400: 00000100:00100000:0.0:1788837766.819796:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732254954240:0@lo:400: 00010000:00010000:2.0:1788837767.721715:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837768.738346:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837769.763192:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788837770.550191:0:6648:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788837770.550197:0:6648:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788837770.550583:0:6648:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97a448f86800 00000020:01000004:3.0:1788837770.550602:0:6648:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788837770.550615:0:6648:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788837770.550630:0:6648:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff97a46e6a3370) 00000020:00000080:3.0:1788837770.550646:0:6648:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788837770.565437:0:6648:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788837770.565694:0:6648:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788837770.637502:0:6648:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788837770.678239:0:6648:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788837770.678277:0:6648:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788837770.678333:0:6648:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788837770.678356:0:6648:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788837770.679474:0:6648:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788837770.679489:0:6648:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788837770.679503:0:6648:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2deb895b363e610a 00000020:01000004:2.0:1788837770.679513:0:6648:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788837770.679881:0:6648:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.154@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788837770.679886:0:6648:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788837770.679892:0:6648:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788837770.679897:0:6648:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788837770.679924:0:6648:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff97a46ec60000) 00000020:00000080:2.0:1788837770.679939:0:6648:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788837770.685703:0:6648:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788837770.686781:0:6648:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788837770.686793:0:6648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788837770.693818:0:6648:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788837770.693846:0:6648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788837770.694812:0:6648:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788837770.694823:0:6648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788837770.704088:0:6648:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788837770.704406:0:6648:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788837770.704414:0:6648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788837770.705702:0:6648:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788837770.705710:0:6648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788837770.763732:0:6648:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788837770.764059:0:6648:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788837770.764065:0:6648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788837770.767055:0:6648:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788837770.767083:0:6648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788837770.768352:0:6648:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788837770.768372:0:6648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788837770.771383:0:6648:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788837770.771612:0:6648:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788837770.771620:0:6648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788837770.776833:0:6648:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788837770.776848:0:6648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:1.0:1788837770.794477:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837770.903904:0:6648:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788837770.904167:0:6648:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788837770.904190:0:6648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788837770.915083:0:6648:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788837770.915105:0:6648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788837770.918760:0:6648:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788837770.918803:0:6648:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788837770.918809:0:6648:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788837770.963763:0:6648:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788837770.963812:0:6648:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.154@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1788837770.963817:0:6648:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788837770.963819:0:6648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788837770.963820:0:6648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837770.963822:0:6648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837770.963823:0:6648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837770.963825:0:6648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837770.963826:0:6648:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788837770.963828:0:6648:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788837770.963829:0:6648:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788837770.963831:0:6648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837770.963833:0:6648:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788837770.963837:0:6648:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1788837770.963840:0:6648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788837770.963841:0:6648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788837770.963842:0:6648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837770.963844:0:6648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837770.963845:0:6648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837770.963851:0:6648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837770.963852:0:6648:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788837770.963853:0:6648:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788837770.963854:0:6648:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788837770.963855:0:6648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837770.963856:0:6648:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788837770.963891:0:6648:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788837770.963909:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254954496:0@lo:253: 00000100:00100000:0.0:1788837770.963979:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837770.964041:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448e43a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788837770.964079:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254954496 00000100:00100000:2.0:1788837770.964088:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254954496 00000100:00100000:3.0:1788837770.964502:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788837770.964624:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a521850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:6648:x1875732254954496:12345-0@lo:253: 20000000:01000000:3.0:1788837770.964668:0:5803:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788837770.964672:0:5803:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1788837770.964677:0:5803:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1788837770.964680:0:5803:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1788837770.965801:0:5803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788837770.966029:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1788837770.966042:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1788837770.966083:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1788837770.966092:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1788837770.966141:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1788837770.966234:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1788837770.976502:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1788837770.976537:0:5803:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.154@tcp 20000000:01000000:3.0:1788837770.976540:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.154@tcp (null) (null) (null) 00000040:00080000:3.0:1788837770.976581:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1788837770.976590:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788837770.976644:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1788837770.976653:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.154@tcp (null) (null) 00000040:00080000:3.0:1788837770.976708:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1788837770.976718:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788837770.976752:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1788837770.976818:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1788837770.977918:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1788837770.977941:0:5803:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.154@tcp 20000000:01000000:3.0:1788837770.977943:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.154@tcp (null) (null) (null) 00000040:00080000:3.0:1788837770.978055:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1788837770.978063:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788837770.978090:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1788837770.978096:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.154@tcp (null) (null) 00000040:00080000:3.0:1788837770.979582:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1788837770.979610:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788837770.979649:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1788837770.979685:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1788837770.979707:0:5803:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788837770.979710:0:5803:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788837770.979714:0:5803:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788837770.979727:0:5803:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788837770.979729:0:5803:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788837770.979772:0:5803:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788837770.979775:0:5803:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788837770.980702:0:6663:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788837770.980772:0:6663:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788837770.980837:0:6663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788837770.981500:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788837770.981545:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788837770.981606:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788837770.981620:0:5803:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788837770.981622:0:5803:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788837770.982282:0:6664:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:1.0:1788837770.982346:0:6664:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:1.0:1788837770.982399:0:6664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788837770.982681:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1788837770.982724:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1788837770.982762:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1788837770.982774:0:5803:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788837770.982776:0:5803:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788837770.983533:0:6665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1788837770.983771:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1788837770.983827:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1788837770.983884:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1788837770.983899:0:5803:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1788837770.983901:0:5803:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1788837770.983910:0:5803:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788837770.983930:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a441521800/0x2deb895b363e6118 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837770.984029:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a440031a00/0x2deb895b363e6031 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e602a expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837770.984039:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a441667800/0x2deb895b363e604d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e6046 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837770.984046:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a441520e00/0x2deb895b363e60bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e60b6 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837770.984054:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a441521800/0x2deb895b363e6118 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837770.984091:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a441520e00/0x2deb895b363e60bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e60b6 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837770.984422:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a441520e00/0x2deb895b363e60bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e60b6 expref: 12 pid: 5802 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837770.984440:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ead3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5803:1875732254954624:0@lo:104: 00000100:00100000:3.0:1788837770.984508:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788837770.984610:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a441667800/0x2deb895b363e604d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e6046 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837770.984630:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a441667800/0x2deb895b363e604d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e6046 expref: 12 pid: 5803 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837770.984639:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ead0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5803:1875732254954752:0@lo:104: 00000100:00100000:3.0:1788837770.984664:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788837770.984767:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a440031a00/0x2deb895b363e6031 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e602a expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837770.984775:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a440031a00/0x2deb895b363e6031 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e602a expref: 12 pid: 5802 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837770.984783:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ead2d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5803:1875732254954880:0@lo:104: 00000100:00100000:3.0:1788837770.984804:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837770.984855:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254954624 00000100:00100000:1.0:1788837770.984862:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254954624 00000100:00100000:1.0:1788837770.984900:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254954752 00000100:00100000:1.0:1788837770.984903:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254954752 00000100:00100000:1.0:1788837770.984918:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788837770.984926:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+4:5803:x1875732254954624:12345-0@lo:104: 00010000:00010000:1.0:1788837770.984938:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a441667000/0x2deb895b363e60b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e60bd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837770.985010:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788837770.985016:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+4:5803:x1875732254954624:12345-0@lo:104: Request processed in 91us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837770.985023:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788837770.985040:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788837770.985054:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+3:5803:x1875732254954752:12345-0@lo:104: 00010000:00010000:1.0:1788837770.985064:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a441465a00/0x2deb895b363e6046 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e604d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837770.985098:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788837770.985103:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+3:5803:x1875732254954752:12345-0@lo:104: Request processed in 51us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837770.985124:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788837770.985143:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788837770.985149:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a441667000/0x2deb895b363e60b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e60bd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837770.985157:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441667000 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:1.0:1788837770.985161:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a441667000/0x2deb895b363e60b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e60bd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837770.985170:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a441667000/0x2deb895b363e60b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e60bd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837770.985189:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a441667000/0x2deb895b363e60b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e60bd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837770.985194:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837770.985254:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a441667000/0x2deb895b363e60b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e60bd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837770.985261:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837770.985279:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a441667000/0x2deb895b363e60b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e60bd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837770.985296:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a441667000/0x2deb895b363e60b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e60bd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837770.985310:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837770.985313:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a441465a00/0x2deb895b363e6046 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e604d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837770.985319:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441465a00 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:1.0:1788837770.985322:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a441465a00/0x2deb895b363e6046 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e604d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837770.985329:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a441465a00/0x2deb895b363e6046 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e604d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837770.985336:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a441465a00/0x2deb895b363e6046 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e604d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837770.985341:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837770.985355:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a441465a00/0x2deb895b363e6046 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e604d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837770.985361:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837770.985367:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a441465a00/0x2deb895b363e6046 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e604d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837770.985374:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a441465a00/0x2deb895b363e6046 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e604d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837770.985383:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837770.985390:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837770.985392:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837770.985414:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459204000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732254955008:0@lo:103: 00000100:00100000:1.0:1788837770.985461:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837770.985487:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788837770.985493:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732254955136:0@lo:103: 00000100:00100000:1.0:1788837770.985512:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837770.985546:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254955008 00000100:00100000:1.0:1788837770.985549:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254955008 00010000:00010000:1.0:1788837770.985567:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a441520e00/0x2deb895b363e60bd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e60b6 expref: 13 pid: 5802 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837770.985587:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254955136 00000100:00100000:1.0:1788837770.985590:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254955136 00010000:00010000:1.0:1788837770.985600:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a441667800/0x2deb895b363e604d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e6046 expref: 14 pid: 5803 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837770.985611:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788837770.985618:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459207800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:3271:x1875732254955008:12345-0@lo:103: 00010000:00010000:1.0:1788837770.985639:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837770.985646:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a441520e00/0x2deb895b363e60bd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e60b6 expref: 14 pid: 5802 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837770.985657:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a441520e00/0x2deb895b363e60bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e60b6 expref: 14 pid: 5802 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837770.985673:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837770.985702:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459207800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:3271:x1875732254955008:12345-0@lo:103: Request processed in 85us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837770.985709:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788837770.985730:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788837770.985736:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459205880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:3271:x1875732254955136:12345-0@lo:103: 00010000:00010000:1.0:1788837770.985743:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837770.985748:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a441667800/0x2deb895b363e604d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e6046 expref: 13 pid: 5803 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837770.985756:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a441667800/0x2deb895b363e604d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e6046 expref: 13 pid: 5803 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837770.985766:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837770.985788:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459205880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:3271:x1875732254955136:12345-0@lo:103: Request processed in 52us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837770.985793:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788837770.985829:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732254955136:0@lo:103: 00000100:00100000:1.0:1788837770.985838:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459204000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732254955008:0@lo:103: 00010000:00010000:0.0:1788837770.985998:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837770.986341:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b1ab480 going to sleep for 11 seconds 00010000:00010000:3.0:1788837770.986356:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a441520e00/0x2deb895b363e60bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e60b6 expref: 12 pid: 5802 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837770.986369:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ead3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5803:1875732254954624:0@lo:104: 00010000:00010000:3.0:1788837770.986379:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a441667800/0x2deb895b363e604d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e6046 expref: 11 pid: 5803 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837770.986387:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ead0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5803:1875732254954752:0@lo:104: 00000100:00100000:1.0:1788837770.986445:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254954880 00000100:00100000:1.0:1788837770.986450:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254954880 00000100:00100000:1.0:1788837770.986471:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788837770.986477:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+3:5803:x1875732254954880:12345-0@lo:104: 00010000:00010000:1.0:1788837770.986486:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a441667c00/0x2deb895b363e602a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e6031 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837770.986538:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788837770.986543:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+3:5803:x1875732254954880:12345-0@lo:104: Request processed in 67us (1739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837770.986548:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788837770.986599:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837770.986605:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a441667c00/0x2deb895b363e602a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e6031 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837770.986611:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441667c00 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:0.0:1788837770.986615:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a441667c00/0x2deb895b363e602a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e6031 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837770.986623:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a441667c00/0x2deb895b363e602a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e6031 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837770.986631:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a441667c00/0x2deb895b363e602a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e6031 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837770.986636:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788837770.986678:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a441667c00/0x2deb895b363e602a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e6031 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837770.986684:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837770.986700:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a441667c00/0x2deb895b363e602a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e6031 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837770.986716:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a441667c00/0x2deb895b363e602a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e6031 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837770.986730:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837770.986733:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837770.986734:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837770.986745:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732254955264:0@lo:103: 00000100:00100000:0.0:1788837770.986777:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837770.986844:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254955264 00000100:00100000:1.0:1788837770.986848:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254955264 00010000:00010000:1.0:1788837770.986868:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a440031a00/0x2deb895b363e6031 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e602a expref: 11 pid: 5802 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837770.986894:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788837770.986900:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+11:3273:x1875732254955264:12345-0@lo:103: 00010000:00010000:1.0:1788837770.986908:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837770.986912:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a440031a00/0x2deb895b363e6031 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e602a expref: 11 pid: 5802 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837770.986921:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a440031a00/0x2deb895b363e6031 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e602a expref: 11 pid: 5802 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837770.986933:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a441521800/0x2deb895b363e6118 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837770.986940:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a441521800/0x2deb895b363e6118 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837770.986963:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a441521800/0x2deb895b363e6118 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837770.986970:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a441521800/0x2deb895b363e6118 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837770.986976:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a441521800/0x2deb895b363e6118 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837770.986981:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a441521800/0x2deb895b363e6118 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837770.986985:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441521800 already unused, calling callback (ffffffffc1616420) 00010000:00010000:1.0:1788837770.986989:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a441521800/0x2deb895b363e6118 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837770.987001:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a441521800/0x2deb895b363e6118 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837770.987008:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a441521800/0x2deb895b363e6118 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837770.987016:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837770.987042:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+11:3273:x1875732254955264:12345-0@lo:103: Request processed in 142us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837770.987048:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788837770.987071:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732254955264:0@lo:103: 00010000:00010000:3.0:1788837770.987390:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a440031a00/0x2deb895b363e6031 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e602a expref: 10 pid: 5802 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837770.987403:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ead2d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5803:1875732254954880:0@lo:104: 00010000:00010000:3.0:1788837770.987421:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a441521800/0x2deb895b363e6118 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837770.987436:0:5803:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97a441521800/0x2deb895b363e6118 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837770.987443:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a441521800/0x2deb895b363e6118 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837770.987449:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a441521800/0x2deb895b363e6118 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788837770.987461:0:5803:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788837771.072719:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a521850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+9:6648:x1875732254954496:12345-0@lo:253: Request processed in 108090us (108730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837771.072734:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788837771.072841:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254954496:0@lo:253: 10000000:01000000:0.0:1788837771.072857:0:6648:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788837771.072860:0:6648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788837771.072862:0:6648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788837771.072863:0:6648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837771.072864:0:6648:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1788837771.072865:0:6648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837771.072866:0:6648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837771.072868:0:6648:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788837771.072869:0:6648:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788837771.072871:0:6648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837771.072872:0:6648:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788837771.072898:0:6648:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97a448f86800 from lustre-OST0000 10000000:01000000:0.0:1788837771.072923:0:6648:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788837771.072925:0:6648:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788837771.072932:0:6648:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97a448f399b8 local copy 10000000:01000000:0.0:1788837771.072937:0:6648:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788837771.072971:0:6648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a440030a00/0x2deb895b363e611f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.072982:0:6648:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.154@tcp lock: ffff97a440030a00/0x2deb895b363e611f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.073011:0:6648:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a440030a00/0x2deb895b363e611f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837771.073030:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254955392:0@lo:101: 00000100:00100000:0.0:1788837771.073082:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837771.073137:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448e43840 going to sleep for 11 seconds 00000100:00100000:1.0:1788837771.073298:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254955392 00000100:00100000:1.0:1788837771.073304:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254955392 00000100:00100000:1.0:1788837771.073361:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788837771.073372:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a522c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+9:6648:x1875732254955392:12345-0@lo:101: 00010000:00010000:1.0:1788837771.073384:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837771.073397:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a441667000/0x2deb895b363e6126 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e611f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.073420:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a441667000/0x2deb895b363e6126 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e611f expref: 10 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.073430:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a441667000/0x2deb895b363e6126 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e611f expref: 10 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.073440:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a441667000, rc 0) 00000100:00100000:1.0:1788837771.073607:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a522c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+10:6648:x1875732254955392:12345-0@lo:101: Request processed in 237us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837771.073625:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788837771.073701:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254955392:0@lo:101: 00010000:00010000:2.0:1788837771.073715:0:6648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a440030a00/0x2deb895b363e611f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2deb895b363e6126 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.073724:0:6648:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a440030a00/0x2deb895b363e611f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2deb895b363e6126 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837771.073831:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254955520:0@lo:501: 00000100:00100000:2.0:1788837771.073861:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837771.073888:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a450a27b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788837771.073938:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254955520 00000100:00100000:1.0:1788837771.073942:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254955520 00000100:00100000:1.0:1788837771.073973:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788837771.073979:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+10:6648:x1875732254955520:12345-0@lo:501: 00000100:00100000:1.0:1788837771.074729:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+10:6648:x1875732254955520:12345-0@lo:501: Request processed in 747us (865us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788837771.074738:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788837771.074884:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254955520:0@lo:501: 10000000:01000000:2.0:1788837771.074900:0:6648:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788837771.074936:0:6648:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788837771.074943:0:6648:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a440030a00/0x2deb895b363e611f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2deb895b363e6126 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.074951:0:6648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a440030a00/0x2deb895b363e611f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2deb895b363e6126 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.074959:0:6648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff97a440030a00/0x2deb895b363e611f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2deb895b363e6126 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.075023:0:6648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788837771.075073:0:6648:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97a448f86800 10000000:01000000:2.0:1788837771.075078:0:6648:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788837771.075083:0:6648:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff97a448f399b8 10000000:01000000:2.0:1788837771.075085:0:6648:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788837771.075088:0:6648:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff97a448f399b8 from 1 10000000:01000000:2.0:1788837771.075091:0:6648:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788837771.075116:0:6648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441465000/0x2deb895b363e612d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.075125:0:6648:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a441465000/0x2deb895b363e612d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.075133:0:6648:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a441465000/0x2deb895b363e612d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837771.075146:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254955648:0@lo:101: 00000100:00100000:2.0:1788837771.075192:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837771.075289:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a450a27e40 going to sleep for 11 seconds 00010000:00010000:0.0:1788837771.075567:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837771.075575:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a440030a00/0x2deb895b363e611f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2deb895b363e6126 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.075582:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a440030a00 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:0.0:1788837771.075586:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a440030a00/0x2deb895b363e611f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2deb895b363e6126 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.075594:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a440030a00/0x2deb895b363e611f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x2deb895b363e6126 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837771.075601:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a440030a00/0x2deb895b363e611f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x2deb895b363e6126 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837771.075606:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788837771.075627:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a440030a00/0x2deb895b363e611f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2deb895b363e6126 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.075633:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837771.075663:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a440030a00/0x2deb895b363e611f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2deb895b363e6126 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.075671:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a440030a00/0x2deb895b363e611f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2deb895b363e6126 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.075694:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837771.075696:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837771.075697:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837771.075740:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837771.075753:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732254955776:0@lo:103: 00000100:00100000:3.0:1788837771.075792:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837771.075859:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254955776 00000100:00100000:0.0:1788837771.075864:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254955776 00000100:00100000:0.0:1788837771.075911:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837771.075920:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+10:3273:x1875732254955776:12345-0@lo:103: 00010000:00010000:0.0:1788837771.075932:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837771.075945:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a441667000/0x2deb895b363e6126 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2deb895b363e611f expref: 10 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.075960:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837771.075995:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+9:3273:x1875732254955776:12345-0@lo:103: Request processed in 76us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837771.076003:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788837771.076076:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732254955776:0@lo:103: 00000100:00100000:1.0:1788837771.076179:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254955648 00000100:00100000:1.0:1788837771.076184:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254955648 00000100:00100000:1.0:1788837771.076238:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788837771.076246:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+9:6648:x1875732254955648:12345-0@lo:101: 00010000:00010000:1.0:1788837771.076256:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837771.076269:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a441666400/0x2deb895b363e6134 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e612d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.076287:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a441666400/0x2deb895b363e6134 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e612d expref: 10 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.076297:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a441666400/0x2deb895b363e6134 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e612d expref: 10 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.076304:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a441666400, rc 0) 00000100:00100000:1.0:1788837771.076618:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+10:6648:x1875732254955648:12345-0@lo:101: Request processed in 372us (1426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837771.076625:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788837771.076690:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254955648:0@lo:101: 00010000:00010000:2.0:1788837771.076705:0:6648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a441465000/0x2deb895b363e612d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6134 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.076714:0:6648:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a441465000/0x2deb895b363e612d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e6134 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837771.076731:0:6648:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788837771.076790:0:6648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441465000/0x2deb895b363e612d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6134 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.076798:0:6648:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a441465000/0x2deb895b363e612d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6134 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837771.076817:0:6648:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788837771.076821:0:6648:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788837771.076826:0:6648:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788837771.076829:0:6648:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788837771.076850:0:6648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441465a00/0x2deb895b363e613b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.076858:0:6648:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a441465a00/0x2deb895b363e613b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.076867:0:6648:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a441465a00/0x2deb895b363e613b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837771.076882:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254955904:0@lo:101: 00000100:00100000:2.0:1788837771.076913:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837771.076989:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a450a27e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837771.077055:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254955904 00000100:00100000:3.0:1788837771.077059:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254955904 00000100:00100000:3.0:1788837771.077130:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788837771.077138:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+10:6648:x1875732254955904:12345-0@lo:101: 00010000:00010000:3.0:1788837771.077147:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837771.077159:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a441521800/0x2deb895b363e6142 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e613b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.077186:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a441521800/0x2deb895b363e6142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e613b expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.077195:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a441521800/0x2deb895b363e6142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e613b expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.077234:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a441521800, rc 0) 00000100:00100000:3.0:1788837771.077274:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+11:6648:x1875732254955904:12345-0@lo:101: Request processed in 137us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837771.077280:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788837771.077366:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254955904:0@lo:101: 00010000:00010000:2.0:1788837771.077378:0:6648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a441465a00/0x2deb895b363e613b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6142 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.077386:0:6648:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a441465a00/0x2deb895b363e613b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e6142 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837771.077501:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254956032:0@lo:501: 00000100:00100000:2.0:1788837771.077529:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837771.077838:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a450a27e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788837771.077918:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254956032 00000100:00100000:0.0:1788837771.077924:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254956032 00000100:00100000:1.0:1788837771.078071:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788837771.078079:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+11:6648:x1875732254956032:12345-0@lo:501: 00000100:00100000:1.0:1788837771.078549:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+11:6648:x1875732254956032:12345-0@lo:501: Request processed in 468us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837771.078557:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788837771.078613:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254956032:0@lo:501: 00000100:00100000:2.0:1788837771.078667:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254956160:0@lo:503: 00000100:00100000:2.0:1788837771.078708:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837771.078819:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a450a27e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837771.078904:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254956160 00000100:00100000:3.0:1788837771.078909:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254956160 00000100:00100000:3.0:1788837771.078937:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788837771.078943:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a521c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+11:6648:x1875732254956160:12345-0@lo:503: 00000100:00100000:3.0:1788837771.079104:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a521c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+11:6648:x1875732254956160:12345-0@lo:503: Request processed in 159us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837771.079110:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788837771.079221:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254956160:0@lo:503: 00000040:00080000:2.0:1788837771.079512:0:6648:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788837771.079593:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254956288:0@lo:502: 00000100:00100000:2.0:1788837771.079634:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837771.079660:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a450a27e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837771.079727:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254956288 00000100:00100000:3.0:1788837771.079731:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254956288 00000100:00100000:3.0:1788837771.079754:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788837771.079760:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a520850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+11:6648:x1875732254956288:12345-0@lo:502: 00000100:00100000:3.0:1788837771.079911:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a520850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+11:6648:x1875732254956288:12345-0@lo:502: Request processed in 150us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837771.079917:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788837771.080059:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254956288:0@lo:502: 00000040:00080000:2.0:1788837771.080371:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788837771.080435:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788837771.080468:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788837771.080514:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788837771.080550:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788837771.080584:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788837771.080613:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254956416:0@lo:502: 00000100:00100000:2.0:1788837771.080657:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837771.080679:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a450a27e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837771.080812:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254956416 00000100:00100000:3.0:1788837771.080819:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254956416 00000100:00100000:3.0:1788837771.080845:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788837771.080851:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a522850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+11:6648:x1875732254956416:12345-0@lo:502: 00000100:00100000:3.0:1788837771.080990:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a522850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+11:6648:x1875732254956416:12345-0@lo:502: Request processed in 138us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837771.080997:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788837771.081145:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254956416:0@lo:502: 00000040:00080000:2.0:1788837771.081290:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788837771.081301:0:6648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1788837771.081994:0:6666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788837771.082002:0:6666:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788837771.082008:0:6666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837771.082010:0:6666:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788837771.082015:0:6666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788837771.082031:0:6666:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff97a46ec619b8) 00000020:00000080:2.0:1788837771.082057:0:6666:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788837771.082063:0:6666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788837771.082130:0:6666:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a448f86800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788837771.082138:0:6666:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788837771.082146:0:6666:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2deb895b363e6150 00010000:00010000:2.0:1788837771.090538:0:6666:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1788837771.090928:0:6666:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788837771.094451:0:6666:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788837771.094797:0:6666:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788837771.104426:0:6666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788837771.105079:0:6666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788837771.106723:0:6666:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788837771.106735:0:6666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837771.106741:0:6666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837771.106743:0:6666:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788837771.106746:0:6666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837771.106750:0:6666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837771.106752:0:6666:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788837771.106754:0:6666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788837771.106756:0:6666:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788837771.106807:0:6666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837771.106811:0:6666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837771.106812:0:6666:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788837771.106815:0:6666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788837771.114464:0:6648:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788837771.114517:0:6648:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788837771.114541:0:6648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441465a00/0x2deb895b363e613b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6142 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.114555:0:6648:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a441465a00/0x2deb895b363e613b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6142 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837771.114588:0:6648:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a448f86800 from 1 10000000:01000000:1.0:1788837771.114591:0:6648:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788837771.114635:0:6648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441666800/0x2deb895b363e6157 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.114643:0:6648:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a441666800/0x2deb895b363e6157 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.114653:0:6648:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a441666800/0x2deb895b363e6157 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837771.114677:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459204000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254956544:0@lo:101: 00000100:00100000:1.0:1788837771.114746:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837771.114793:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47ba8b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837771.117027:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254956544 00000100:00100000:3.0:1788837771.117049:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254956544 00000100:00100000:3.0:1788837771.117217:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788837771.117227:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+11:6648:x1875732254956544:12345-0@lo:101: 00010000:00010000:3.0:1788837771.117246:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837771.117263:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a441520e00/0x2deb895b363e615e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e6157 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.117291:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a441520e00/0x2deb895b363e615e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e6157 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.117302:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a441520e00/0x2deb895b363e615e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e6157 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.117311:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a441520e00, rc 0) 00000100:00100000:3.0:1788837771.118128:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:6648:x1875732254956544:12345-0@lo:101: Request processed in 900us (3378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837771.118137:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788837771.118808:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459204000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254956544:0@lo:101: 00010000:00010000:1.0:1788837771.118837:0:6648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a441666800/0x2deb895b363e6157 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e615e expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.118864:0:6648:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a441666800/0x2deb895b363e6157 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e615e expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837771.119007:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459204000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254956672:0@lo:501: 00000100:00100000:1.0:1788837771.119054:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837771.119105:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254956672 00000100:00100000:1.0:1788837771.119121:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254956672 00000100:00100000:1.0:1788837771.119157:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788837771.119165:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a523c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:6648:x1875732254956672:12345-0@lo:501: 00000100:00100000:1.0:1788837771.120142:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a523c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:6648:x1875732254956672:12345-0@lo:501: Request processed in 940us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837771.120153:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788837771.120258:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47ba8b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837771.120279:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459204000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254956672:0@lo:501: 00000100:00100000:1.0:1788837771.120313:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459204000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254956800:0@lo:503: 00000100:00100000:1.0:1788837771.120503:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837771.120662:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47ba8b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837771.122687:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254956800 00000100:00100000:3.0:1788837771.122701:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254956800 00000100:00100000:3.0:1788837771.122760:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788837771.122770:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:6648:x1875732254956800:12345-0@lo:503: 00000100:00100000:3.0:1788837771.123744:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:6648:x1875732254956800:12345-0@lo:503: Request processed in 972us (3237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837771.123755:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788837771.123845:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459204000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254956800:0@lo:503: 00000040:00080000:3.0:1788837771.127412:0:6648:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788837771.127510:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ead0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254956928:0@lo:502: 00000100:00100000:3.0:1788837771.128086:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837771.128151:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b1ab9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837771.128239:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254956928 00000100:00100000:1.0:1788837771.128248:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254956928 00000100:00100000:1.0:1788837771.128297:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788837771.128307:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:6648:x1875732254956928:12345-0@lo:502: 00000100:00100000:1.0:1788837771.128609:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:6648:x1875732254956928:12345-0@lo:502: Request processed in 303us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837771.128617:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788837771.128731:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ead0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254956928:0@lo:502: 00000040:00080000:0.0:1788837771.129004:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788837771.129061:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788837771.129092:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254957056:0@lo:502: 00000100:00100000:0.0:1788837771.129279:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837771.129305:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448e43240 going to sleep for 11 seconds 00000100:00100000:1.0:1788837771.129904:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254957056 00000100:00100000:1.0:1788837771.129916:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254957056 00000100:00100000:1.0:1788837771.130021:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788837771.130030:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:6648:x1875732254957056:12345-0@lo:502: 00000100:00100000:1.0:1788837771.130336:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:6648:x1875732254957056:12345-0@lo:502: Request processed in 306us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837771.130344:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788837771.130608:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254957056:0@lo:502: 00000040:00080000:0.0:1788837771.130744:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788837771.130760:0:6648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788837771.133836:0:6670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837771.133853:0:6670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837771.133855:0:6670:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788837771.133862:0:6670:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a448f86800 00000020:00000080:0.0:1788837771.133864:0:6670:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788837771.133887:0:6670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837771.133890:0:6670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837771.133891:0:6670:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788837771.133894:0:6670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788837771.134033:0:6648:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788837771.134058:0:6648:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788837771.134078:0:6648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441666800/0x2deb895b363e6157 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e615e expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.134089:0:6648:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a441666800/0x2deb895b363e6157 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e615e expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837771.134307:0:6648:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788837771.134311:0:6648:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97a448f86800 10000000:01000000:3.0:1788837771.134314:0:6648:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97a448f86800 10000000:01000000:3.0:1788837771.134318:0:6648:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788837771.134324:0:6648:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97a448f86800 from 1 10000000:01000000:3.0:1788837771.134327:0:6648:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788837771.134441:0:6648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441520a00/0x2deb895b363e6165 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.134450:0:6648:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a441520a00/0x2deb895b363e6165 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.134461:0:6648:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a441520a00/0x2deb895b363e6165 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837771.134486:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ead3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254957184:0@lo:101: 00000100:00100000:3.0:1788837771.134641:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837771.134689:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b1ab540 going to sleep for 11 seconds 00000100:00100000:0.0:1788837771.135000:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254957184 00000100:00100000:0.0:1788837771.135008:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254957184 00000100:00100000:0.0:1788837771.135060:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788837771.135069:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:6648:x1875732254957184:12345-0@lo:101: 00010000:00010000:0.0:1788837771.135081:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837771.135093:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a440030a00/0x2deb895b363e616c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e6165 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.135126:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a440030a00/0x2deb895b363e616c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e6165 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.135136:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a440030a00/0x2deb895b363e616c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e6165 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.135144:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a440030a00, rc 0) 00000100:00100000:0.0:1788837771.135214:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:6648:x1875732254957184:12345-0@lo:101: Request processed in 133us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837771.135221:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788837771.135252:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ead3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254957184:0@lo:101: 00010000:00010000:3.0:1788837771.135267:0:6648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a441520a00/0x2deb895b363e6165 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e616c expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.135289:0:6648:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a441520a00/0x2deb895b363e6165 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e616c expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837771.135486:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ead3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254957312:0@lo:501: 00000100:00100000:3.0:1788837771.135653:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837771.136138:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b1ab540 going to sleep for 11 seconds 00000100:00100000:1.0:1788837771.136485:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254957312 00000100:00100000:1.0:1788837771.136491:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254957312 00000100:00100000:1.0:1788837771.136692:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788837771.136702:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:6648:x1875732254957312:12345-0@lo:501: 00000100:00100000:1.0:1788837771.136990:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:6648:x1875732254957312:12345-0@lo:501: Request processed in 289us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837771.136998:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788837771.137080:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ead3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254957312:0@lo:501: 00000100:00100000:0.0:1788837771.137130:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254957440:0@lo:503: 00000100:00100000:0.0:1788837771.137182:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837771.137229:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448e433c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837771.137343:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254957440 00000100:00100000:1.0:1788837771.137349:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254957440 00000100:00100000:1.0:1788837771.137387:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788837771.137394:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:6648:x1875732254957440:12345-0@lo:503: 00000100:00100000:1.0:1788837771.137732:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:6648:x1875732254957440:12345-0@lo:503: Request processed in 337us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837771.137739:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788837771.137819:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254957440:0@lo:503: 00000040:00080000:3.0:1788837771.138143:0:6648:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788837771.138259:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ead3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254957568:0@lo:502: 00000100:00100000:3.0:1788837771.138303:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837771.138328:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b1abf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788837771.138705:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254957568 00000100:00100000:1.0:1788837771.138712:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254957568 00000100:00100000:1.0:1788837771.138749:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788837771.138758:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:6648:x1875732254957568:12345-0@lo:502: 00000100:00100000:1.0:1788837771.138968:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:6648:x1875732254957568:12345-0@lo:502: Request processed in 208us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837771.138974:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788837771.139133:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ead3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254957568:0@lo:502: 00000040:00080000:2.0:1788837771.139466:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788837771.139522:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788837771.139576:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788837771.139627:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788837771.139667:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788837771.139721:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788837771.139759:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788837771.139810:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788837771.139863:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788837771.139902:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788837771.139938:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788837771.140257:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788837771.140294:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788837771.140330:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788837771.140634:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788837771.140679:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788837771.140717:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788837771.140784:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788837771.140841:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788837771.140879:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788837771.140932:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788837771.141164:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788837771.141276:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788837771.141332:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788837771.141605:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788837771.141650:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788837771.141707:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788837771.141745:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1788837771.141802:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254957696:0@lo:502: 00000100:00100000:2.0:1788837771.141886:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837771.142005:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a450a27e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788837771.142662:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254957696 00000100:00100000:1.0:1788837771.142671:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254957696 00000100:00100000:1.0:1788837771.142767:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788837771.142777:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:6648:x1875732254957696:12345-0@lo:502: 00000100:00100000:1.0:1788837771.146741:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:6648:x1875732254957696:12345-0@lo:502: Request processed in 3954us (4844us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837771.146756:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788837771.147014:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254957696:0@lo:502: 00000040:00080000:3.0:1788837771.147161:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788837771.147189:0:6648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788837771.148374:0:6671:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788837771.148391:0:6671:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff97a46e6a4d28) 00000020:00000080:3.0:1788837771.148435:0:6671:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1788837771.148521:0:6671:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a448f86800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788837771.148656:0:6671:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97a448f86800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788837771.148659:0:6671:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a448f86800 3 00010000:00080000:3.0:1788837771.148702:0:6671:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a345202000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.154@tcp at head 00010000:00010000:2.0:1788837771.152143:0:6671:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1788837771.153056:0:6671:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788837771.153099:0:6671:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788837771.153114:0:6671:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2deb895b363e617a 00000100:00080000:2.0:1788837771.153126:0:6671:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788837771.153132:0:6671:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97a345202000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788837771.153181:0:6671:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a46f4baa00 x1875732254957824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788837771.153234:0:6671:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788837771.153348:0:3270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3270:1875732254957824:0@lo:38: 00000100:00100000:1.0:1788837771.153435:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837771.153763:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254957824 00000100:00100000:1.0:1788837771.153772:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254957824 00000100:00100000:1.0:1788837771.153815:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788837771.153822:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459205f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3270:x1875732254957824:12345-0@lo:38: 00010000:00080000:1.0:1788837771.153847:0:5810:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 151 last 0 00000020:00000080:1.0:1788837771.153877:0:5810:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2deb895b363e6181 00000004:00100000:1.0:1788837771.153891:0:5810:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788837771.153920:0:5810:0:(import.c:65:import_set_state_nolock()) ffff97a461927000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788837771.153975:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459205f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3270:x1875732254957824:12345-0@lo:38: Request processed in 152us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837771.153982:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788837771.154020:0:3270:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97a46f4baa00 x1875732254957824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788837781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837771.154031:0:3270:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788837771.154038:0:3270:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788837771.154045:0:3270:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788837771.154049:0:3270:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788837771.154051:0:3270:0:(import.c:65:import_set_state_nolock()) ffff97a345202000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788837771.154066:0:3270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3270:1875732254957824:0@lo:38: 00000100:00100000:3.0:1788837771.157382:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ead1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732254957952:0@lo:400: 00000100:00100000:3.0:1788837771.157463:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837771.157548:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254957952 00000100:00100000:3.0:1788837771.157556:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254957952 00000100:00100000:3.0:1788837771.157603:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788837771.157619:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732254957952:12345-0@lo:400: 00000100:00100000:3.0:1788837771.157672:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732254957952:12345-0@lo:400: Request processed in 54us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837771.157679:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788837771.157723:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97a46ead1500 x1875732254957952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837771.157738:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ead1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732254957952:0@lo:400: 00000040:00080000:2.0:1788837771.161495:0:6671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1788837771.161571:0:6648:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788837771.161593:0:6648:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788837771.161615:0:6648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441520a00/0x2deb895b363e6165 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e616c expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.161626:0:6648:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a441520a00/0x2deb895b363e6165 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e616c expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788837771.161669:0:6648:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788837771.161671:0:6648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788837771.161673:0:6648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788837771.161674:0:6648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788837771.161675:0:6648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788837771.161677:0:6648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788837771.161678:0:6648:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788837771.161679:0:6648:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788837771.161681:0:6648:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788837771.161682:0:6648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788837771.161684:0:6648:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788837771.161688:0:6648:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788837771.161690:0:6648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788837771.161691:0:6648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788837771.161692:0:6648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788837771.161693:0:6648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788837771.161694:0:6648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788837771.161696:0:6648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788837771.161697:0:6648:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788837771.161698:0:6648:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788837771.161699:0:6648:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788837771.161700:0:6648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788837771.161700:0:6648:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788837771.161727:0:6648:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788837771.161744:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254958080:0@lo:253: 00000100:00100000:2.0:1788837771.161820:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837771.161857:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a450a27e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837771.162392:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254958080 00000100:00100000:3.0:1788837771.162401:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254958080 00000100:00100000:3.0:1788837771.162448:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788837771.162458:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:6648:x1875732254958080:12345-0@lo:253: 20000000:01000000:3.0:1788837771.162489:0:5803:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788837771.162503:0:5803:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788837771.200957:0:5803:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788837771.200975:0:5803:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788837771.201036:0:5824:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788837771.201041:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788837771.201064:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a440031a00/0x2deb895b363e6188 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.201083:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a441521000/0x2deb895b363e60e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e60e0 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.201091:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a440031a00/0x2deb895b363e6188 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.201131:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a441521000/0x2deb895b363e60e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e60e0 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.201145:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a441521000/0x2deb895b363e60e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e60e0 expref: 13 pid: 5803 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837771.201160:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5824:1875732254958208:0@lo:104: 00000100:00100000:0.0:1788837771.201261:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837771.201328:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a44a70c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788837771.201710:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254958208 00000100:00100000:2.0:1788837771.201721:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254958208 00000100:00100000:2.0:1788837771.201779:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788837771.201789:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+3:5824:x1875732254958208:12345-0@lo:104: 00010000:00010000:2.0:1788837771.201804:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a440030c00/0x2deb895b363e60e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e60e7 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.201865:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788837771.201872:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+3:5824:x1875732254958208:12345-0@lo:104: Request processed in 85us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837771.201880:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788837771.201902:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837771.201909:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a440030c00/0x2deb895b363e60e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e60e7 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.201917:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a440030c00 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:2.0:1788837771.201921:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a440030c00/0x2deb895b363e60e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e60e7 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.201930:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a440030c00/0x2deb895b363e60e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e60e7 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837771.201938:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a440030c00/0x2deb895b363e60e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e60e7 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837771.201959:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788837771.202004:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a440030c00/0x2deb895b363e60e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e60e7 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.202011:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788837771.202029:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a440030c00/0x2deb895b363e60e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e60e7 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.202036:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a440030c00/0x2deb895b363e60e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e60e7 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.202055:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837771.202058:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837771.202059:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837771.202079:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732254958336:0@lo:103: 00000100:00100000:2.0:1788837771.202116:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837771.202184:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254958336 00000100:00100000:2.0:1788837771.202189:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254958336 00010000:00010000:2.0:1788837771.202244:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a441521000/0x2deb895b363e60e7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e60e0 expref: 14 pid: 5803 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837771.202268:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788837771.202275:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4497d5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:3272:x1875732254958336:12345-0@lo:103: 00010000:00010000:2.0:1788837771.202286:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837771.202290:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a441521000/0x2deb895b363e60e7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e60e0 expref: 14 pid: 5803 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.202300:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a441521000/0x2deb895b363e60e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e60e0 expref: 14 pid: 5803 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.202315:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a440031a00/0x2deb895b363e6188 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.202330:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a440031a00/0x2deb895b363e6188 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788837771.202342:0:5795:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002095110s 00010000:00010000:2.0:1788837771.202347:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a440031a00/0x2deb895b363e6188 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.202594:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a440031a00/0x2deb895b363e6188 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.202601:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a440031a00/0x2deb895b363e6188 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.202608:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a440031a00/0x2deb895b363e6188 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.202613:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a440031a00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:2.0:1788837771.202617:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a440031a00/0x2deb895b363e6188 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.202624:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a440031a00/0x2deb895b363e6188 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.202632:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a440031a00/0x2deb895b363e6188 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.202641:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837771.203022:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4497d5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:3272:x1875732254958336:12345-0@lo:103: Request processed in 746us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837771.203029:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788837771.203123:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a441521000/0x2deb895b363e60e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e60e0 expref: 13 pid: 5803 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837771.203135:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5824:1875732254958208:0@lo:104: 00010000:00010000:2.0:1788837771.203152:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a440031a00/0x2deb895b363e6188 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.203160:0:5824:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97a440031a00/0x2deb895b363e6188 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.203165:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a440031a00/0x2deb895b363e6188 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.203182:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a440031a00/0x2deb895b363e6188 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837771.209512:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732254958336:0@lo:103: 00000100:00100000:3.0:1788837771.223734:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:6648:x1875732254958080:12345-0@lo:253: Request processed in 61266us (61902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837771.223750:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788837771.223872:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6648:1875732254958080:0@lo:253: 10000000:01000000:2.0:1788837771.223889:0:6648:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788837771.223893:0:6648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788837771.223894:0:6648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788837771.223895:0:6648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788837771.223897:0:6648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788837771.223898:0:6648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788837771.223899:0:6648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788837771.223901:0:6648:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788837771.223902:0:6648:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788837771.223903:0:6648:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788837771.223905:0:6648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788837771.223907:0:6648:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788837771.223924:0:6648:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788837771.234700:0:6648:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788837771.234917:0:6648:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788837771.235610:0:6648:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788837771.235772:0:6648:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788837771.236120:0:6648:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788837771.237109:0:6648:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788837771.238769:0:6648:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 10000000:01000000:1.0:1788837771.520622:0:5805:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788837771.520630:0:5805:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97a448c63800 from 21 10000000:01000000:1.0:1788837771.520635:0:5805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788837771.520680:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441666200/0x2deb895b363e618f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.520691:0:5805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a441666200/0x2deb895b363e618f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.520702:0:5805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a441666200/0x2deb895b363e618f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837771.520726:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459207b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254958464:0@lo:101: 00000100:00100000:1.0:1788837771.520795:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837771.520865:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a3410839c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837771.520928:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254958464 00000100:00100000:0.0:1788837771.520937:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254958464 00000100:00100000:0.0:1788837771.520994:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788837771.521003:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:5805:x1875732254958464:12345-0@lo:101: 00010000:00010000:0.0:1788837771.521018:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837771.521031:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a440030600/0x2deb895b363e6196 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e618f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.521056:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a440030600/0x2deb895b363e6196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e618f expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.521079:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a440030600/0x2deb895b363e6196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e618f expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.521089:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a440030600, rc 0) 00000100:00100000:0.0:1788837771.521138:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:5805:x1875732254958464:12345-0@lo:101: Request processed in 136us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837771.521144:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788837771.521368:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459207b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254958464:0@lo:101: 00010000:00010000:1.0:1788837771.521383:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a441666200/0x2deb895b363e618f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6196 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.521392:0:5805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a441666200/0x2deb895b363e618f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e6196 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837771.521445:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459207b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254958592:0@lo:501: 00000100:00100000:1.0:1788837771.521473:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837771.521499:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a3410839c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837771.521787:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254958592 00000100:00100000:3.0:1788837771.521794:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254958592 00000100:00100000:3.0:1788837771.521835:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788837771.521842:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:5805:x1875732254958592:12345-0@lo:501: 00000100:00100000:3.0:1788837771.522033:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:5805:x1875732254958592:12345-0@lo:501: Request processed in 191us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837771.522041:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788837771.524679:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459207b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254958592:0@lo:501: 00000100:00100000:1.0:1788837771.524745:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459207b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254958720:0@lo:503: 00000100:00100000:1.0:1788837771.524826:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837771.524868:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a3410839c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837771.526840:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254958720 00000100:00100000:3.0:1788837771.526855:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254958720 00000100:00100000:3.0:1788837771.526916:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788837771.526926:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:5805:x1875732254958720:12345-0@lo:503: 00000100:00100000:3.0:1788837771.527152:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:5805:x1875732254958720:12345-0@lo:503: Request processed in 227us (2325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837771.527159:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788837771.527179:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459207b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254958720:0@lo:503: 00000100:00100000:0.0:1788837771.528726:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6675:1875732254958848:0@lo:502: 00000100:00100000:0.0:1788837771.528801:0:6675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837771.529025:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a44959c600 going to sleep for 11 seconds 00000100:00100000:1.0:1788837771.531125:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254958848 00000100:00100000:1.0:1788837771.531141:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254958848 00000100:00100000:1.0:1788837771.531240:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788837771.531250:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:6675:x1875732254958848:12345-0@lo:502: 00000100:00100000:1.0:1788837771.531805:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:6675:x1875732254958848:12345-0@lo:502: Request processed in 555us (3002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837771.531814:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788837771.533938:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6675:1875732254958848:0@lo:502: 00000100:00100000:0.0:1788837771.534034:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6675:1875732254958976:0@lo:502: 00000100:00100000:0.0:1788837771.534123:0:6675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837771.534170:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4509579c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837771.538112:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254958976 00000100:00100000:1.0:1788837771.538128:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254958976 00000100:00100000:2.0:1788837771.538505:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788837771.538549:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:6675:x1875732254958976:12345-0@lo:502: 00000100:00100000:2.0:1788837771.539190:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:6675:x1875732254958976:12345-0@lo:502: Request processed in 644us (5065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837771.539222:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788837771.539558:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6675:1875732254958976:0@lo:502: 00000040:00080000:0.0:1788837771.539599:0:6675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788837771.539737:0:5805:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788837771.539760:0:5805:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788837771.539770:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441666200/0x2deb895b363e618f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6196 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.539783:0:5805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a441666200/0x2deb895b363e618f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6196 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837771.539794:0:5805:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788837771.539797:0:5805:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97a448c63800 from 4 10000000:01000000:3.0:1788837771.539800:0:5805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788837771.539853:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441521600/0x2deb895b363e619d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.539861:0:5805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a441521600/0x2deb895b363e619d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.539870:0:5805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a441521600/0x2deb895b363e619d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837771.539889:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ead1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254959104:0@lo:101: 00000100:00100000:3.0:1788837771.539935:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837771.540119:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b1ab3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837771.540229:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254959104 00000100:00100000:1.0:1788837771.540236:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254959104 00000100:00100000:1.0:1788837771.540276:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788837771.540286:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:5805:x1875732254959104:12345-0@lo:101: 00010000:00010000:1.0:1788837771.540297:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837771.540309:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a441667000/0x2deb895b363e61a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e619d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.540331:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a441667000/0x2deb895b363e61a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e619d expref: 14 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.540342:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a441667000/0x2deb895b363e61a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e619d expref: 14 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.540360:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a441667000, rc 0) 00000100:00100000:1.0:1788837771.540394:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:5805:x1875732254959104:12345-0@lo:101: Request processed in 110us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837771.540401:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788837771.540797:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ead1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254959104:0@lo:101: 00010000:00010000:3.0:1788837771.540812:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a441521600/0x2deb895b363e619d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e61a4 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.541095:0:5805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a441521600/0x2deb895b363e619d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e61a4 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837771.541148:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ead1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254959232:0@lo:256: 00000100:00100000:3.0:1788837771.542218:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837771.542255:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b1ab3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837771.542481:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254959232 00000100:00100000:0.0:1788837771.542490:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254959232 00000100:00100000:0.0:1788837771.542544:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788837771.542553:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:5805:x1875732254959232:12345-0@lo:256: 20000000:01000000:0.0:1788837771.542577:0:5803:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788837771.542605:0:5803:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788837771.542608:0:5803:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788837771.542708:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:5805:x1875732254959232:12345-0@lo:256: Request processed in 154us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837771.542715:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788837771.542727:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ead1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254959232:0@lo:256: 10000000:01000000:3.0:1788837771.542776:0:5805:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788837771.542785:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441521600/0x2deb895b363e619d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e61a4 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.542795:0:5805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a441521600/0x2deb895b363e619d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e61a4 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837771.542803:0:5805:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788837771.542806:0:5805:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788837771.542808:0:5805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788837771.543683:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441520400/0x2deb895b363e61ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.543696:0:5805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a441520400/0x2deb895b363e61ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.543705:0:5805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a441520400/0x2deb895b363e61ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837771.543725:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ead1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254959360:0@lo:101: 00000100:00100000:3.0:1788837771.543778:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837771.543818:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b1ab3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837771.543822:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254959360 00000100:00100000:2.0:1788837771.543829:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254959360 00000100:00100000:2.0:1788837771.544997:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788837771.545011:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:5805:x1875732254959360:12345-0@lo:101: 00010000:00010000:2.0:1788837771.545024:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837771.545041:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a441464600/0x2deb895b363e61b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e61ab expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.545077:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a441464600/0x2deb895b363e61b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e61ab expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.545088:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a441464600/0x2deb895b363e61b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e61ab expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.545096:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a441464600, rc 0) 00000100:00100000:2.0:1788837771.545170:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:5805:x1875732254959360:12345-0@lo:101: Request processed in 153us (1382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837771.545177:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788837771.545224:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ead1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254959360:0@lo:101: 00010000:00010000:3.0:1788837771.545239:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a441520400/0x2deb895b363e61ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e61b2 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.545249:0:5805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a441520400/0x2deb895b363e61ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e61b2 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837771.545317:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ead1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254959488:0@lo:501: 00000100:00100000:3.0:1788837771.545361:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1788837771.550654:0:6648:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788837771.550661:0:6648:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788837771.550696:0:6648:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788837771.550761:0:6648:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788837771.550776:0:6648:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788837771.550807:0:6648:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00000100:00100000:0.0:1788837771.555447:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254959488 00000100:00100000:0.0:1788837771.555461:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254959488 00000100:00100000:2.0:1788837771.557949:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b1ab3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837771.576954:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788837771.576968:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4551a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:5805:x1875732254959488:12345-0@lo:501: 00000100:00100000:0.0:1788837771.577294:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4551a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:5805:x1875732254959488:12345-0@lo:501: Request processed in 328us (31931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837771.577302:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788837771.578444:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ead1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254959488:0@lo:501: 00000100:00100000:0.0:1788837771.578506:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254959616:0@lo:503: 00000100:00100000:0.0:1788837771.578569:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837771.578695:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a346b713c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837771.578733:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254959616 00000100:00100000:1.0:1788837771.578740:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254959616 00000100:00100000:1.0:1788837771.578809:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788837771.578817:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4551ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:5805:x1875732254959616:12345-0@lo:503: 00000100:00100000:1.0:1788837771.579038:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4551ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:5805:x1875732254959616:12345-0@lo:503: Request processed in 220us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837771.579045:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788837771.579123:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254959616:0@lo:503: 00000100:00100000:0.0:1788837771.579508:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6677:1875732254959744:0@lo:502: 00000100:00100000:0.0:1788837771.579546:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837771.579571:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a346b71b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788837771.579792:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254959744 00000100:00100000:1.0:1788837771.579798:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254959744 00000100:00100000:1.0:1788837771.579867:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788837771.579875:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4551a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:6677:x1875732254959744:12345-0@lo:502: 00000100:00100000:1.0:1788837771.580113:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4551a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:6677:x1875732254959744:12345-0@lo:502: Request processed in 238us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837771.580120:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788837771.580264:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6677:1875732254959744:0@lo:502: 00000020:01000000:2.0:1788837771.580289:0:6677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788837771.580297:0:6677:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788837771.580310:0:6677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837771.580312:0:6677:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788837771.580317:0:6677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788837771.580321:0:6677:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:01000000:2.0:1788837771.580414:0:6677:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788837771.580418:0:6677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788837771.580433:0:6677:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff97a46ec63370) 00000020:00000080:2.0:1788837771.580453:0:6677:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1788837771.580459:0:6677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788837771.580531:0:6677:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788837771.580538:0:6677:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788837771.580545:0:6677:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2deb895b363e61c0 00010000:00080000:2.0:1788837771.580572:0:6677:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a47b5aa000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:2.0:1788837771.580790:0:6677:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788837771.668328:0:6677:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788837771.668355:0:6677:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788837771.668955:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788837771.669109:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788837771.669185:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788837771.669272:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788837771.672851:0:6679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788837771.672862:0:6679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788837771.679748:0:6677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788837771.679768:0:6677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788837771.679816:0:6677:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788837771.679843:0:6677:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2deb895b363e61c7 00000100:00080000:0.0:1788837771.679858:0:6677:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788837771.679873:0:6677:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97a47b5aa000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788837771.679915:0:6677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a46f4d2680 x1875732254959872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788837771.679944:0:6677:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788837771.680013:0:6677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837771.680017:0:6677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837771.680019:0:6677:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788837771.680022:0:6677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837771.680025:0:6677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837771.680026:0:6677:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788837771.680029:0:6677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788837771.680030:0:6677:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788837771.680056:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6677:1875732254960000:0@lo:502: 00000100:00100000:0.0:1788837771.680136:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837771.680191:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a346b71000 going to sleep for 11 seconds 00000100:00100000:0.0:1788837771.680245:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254960000 00000100:00100000:0.0:1788837771.680251:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254960000 00000100:00100000:0.0:1788837771.680289:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788837771.680299:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a460089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:6677:x1875732254960000:12345-0@lo:502: 00000100:00100000:0.0:1788837771.680530:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a460089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:6677:x1875732254960000:12345-0@lo:502: Request processed in 232us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837771.680538:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788837771.680592:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:6677:1875732254960000:0@lo:502: 00000020:01000000:0.0:1788837771.680616:0:6677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837771.680621:0:6677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837771.680622:0:6677:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788837771.680626:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:1.0:1788837771.680809:0:3270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3270:1875732254959872:0@lo:8: 00000100:00100000:1.0:1788837771.680850:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788837771.680972:0:5805:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788837771.680990:0:5805:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788837771.681010:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441520400/0x2deb895b363e61ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e61b2 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.681024:0:5805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a441520400/0x2deb895b363e61ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e61b2 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837771.681034:0:5805:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788837771.681037:0:5805:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97a448f399b8 from 1 10000000:01000000:2.0:1788837771.681040:0:5805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788837771.681066:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441465e00/0x2deb895b363e61ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.681074:0:5805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a441465e00/0x2deb895b363e61ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.681096:0:5805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a441465e00/0x2deb895b363e61ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837771.681111:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254960128:0@lo:101: 00000100:00100000:2.0:1788837771.681140:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837771.681173:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a44a56fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788837771.681189:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254960128 00000100:00100000:2.0:1788837771.681193:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254960128 00000100:00100000:2.0:1788837771.681245:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788837771.681253:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a460088c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:5805:x1875732254960128:12345-0@lo:101: 00010000:00010000:2.0:1788837771.681263:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837771.681277:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a441464e00/0x2deb895b363e61d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e61ce expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.681299:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a441464e00/0x2deb895b363e61d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e61ce expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.681310:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a441464e00/0x2deb895b363e61d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e61ce expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.681318:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a441464e00, rc 0) 00000100:00100000:2.0:1788837771.681352:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a460088c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:5805:x1875732254960128:12345-0@lo:101: Request processed in 100us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837771.681358:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788837771.681388:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254960128:0@lo:101: 00010000:00010000:2.0:1788837771.681400:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a441465e00/0x2deb895b363e61ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e61d5 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.681420:0:5805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a441465e00/0x2deb895b363e61ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e61d5 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837771.681462:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254960256:0@lo:501: 00000100:00100000:2.0:1788837771.681485:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837771.681504:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a44a56fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788837771.681515:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254960256 00000100:00100000:2.0:1788837771.681520:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254960256 00000100:00100000:2.0:1788837771.681540:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788837771.681545:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:5805:x1875732254960256:12345-0@lo:501: 00000100:00100000:2.0:1788837771.681787:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:5805:x1875732254960256:12345-0@lo:501: Request processed in 240us (300us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788837771.681794:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788837771.681827:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254960256:0@lo:501: 10000000:01000000:2.0:1788837771.681852:0:5805:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788837771.681857:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441465e00/0x2deb895b363e61ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e61d5 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.681865:0:5805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a441465e00/0x2deb895b363e61ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e61d5 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837771.683143:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254959872 00000100:00100000:0.0:1788837771.683167:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254959872 00000100:00100000:2.0:1788837771.683533:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788837771.683542:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459205c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3270:x1875732254959872:12345-0@lo:8: 00010000:00080000:2.0:1788837771.683577:0:6652:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 151 last 0 00000020:00000080:2.0:1788837771.683703:0:6652:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2deb895b363e61dc 00002000:00100000:2.0:1788837771.683764:0:6652:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff97a458c4c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113975 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788837771.683770:0:6652:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1788837771.683775:0:6652:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788837771.683909:0:6652:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788837771.684076:0:6652:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788837771.684102:0:6652:0:(import.c:65:import_set_state_nolock()) ffff97a458c4b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788837771.684288:0:6650:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788837771.684298:0:6650:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788837771.684438:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459205c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3270:x1875732254959872:12345-0@lo:8: Request processed in 895us (3586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837771.684448:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788837771.684800:0:3270:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff97a46f4d2680 x1875732254959872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788837781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837771.684813:0:3270:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788837771.684823:0:3270:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788837771.684832:0:3270:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788837771.684845:0:3270:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788837771.684848:0:3270:0:(import.c:65:import_set_state_nolock()) ffff97a47b5aa000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788837771.684983:0:3270:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788837771.684990:0:3270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3270:1875732254959872:0@lo:8: 00000004:00080000:0.0:1788837771.685061:0:6679:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788837771.685475:0:6679:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 151778996207ns, next at 0ns, rc = 0 00000004:00080000:1.0:1788837771.754065:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1788837771.811261:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788837771.844435:0:6680:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788837771.844472:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4bb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6680:1875732254960512:0@lo:7: 00000100:00100000:2.0:1788837771.844557:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837771.844601:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254960512 00000100:00100000:3.0:1788837771.844612:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254960512 00000100:00100000:2.0:1788837771.844614:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a44a56f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788837771.844680:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788837771.844692:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6680:x1875732254960512:12345-0@lo:7: 00000100:00100000:2.0:1788837771.849172:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254960384:0@lo:13: 00000100:00100000:2.0:1788837771.849282:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837771.850013:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254960384 00000100:00100000:1.0:1788837771.850025:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254960384 00000100:00100000:1.0:1788837771.850079:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788837771.850089:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3273:x1875732254960384:12345-0@lo:13: 00002000:00000024:1.0:1788837771.850113:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:1.0:1788837771.850183:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3273:x1875732254960384:12345-0@lo:13: Request processed in 95us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837771.850190:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788837771.850797:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a46f4bad80 x1875732254960384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837787 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837771.850820:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254960384:0@lo:13: 00000100:00080000:0.0:1788837771.851522:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1788837771.859771:0:6653:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788837771.859780:0:6653:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788837771.859875:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6680:x1875732254960512:12345-0@lo:7: Request processed in 15183us (15314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837771.859887:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788837771.860168:0:6680:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a46f4bb480 x1875732254960512/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788837787 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837771.860183:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4bb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6680:1875732254960512:0@lo:7: 00000004:00080000:2.0:1788837771.860199:0:6680:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788837771.860540:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4bb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6680:1875732254960640:0@lo:5: 00000100:00100000:2.0:1788837771.860579:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837771.860662:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a44a56f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788837771.861296:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254960640 00000100:00100000:0.0:1788837771.861306:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254960640 00000100:00100000:0.0:1788837771.861353:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788837771.861424:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6680:x1875732254960640:12345-0@lo:5: 00002000:00080000:0.0:1788837771.861454:0:6650:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788837771.861460:0:6650:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788837771.861953:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6680:x1875732254960640:12345-0@lo:5: Request processed in 531us (1372us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788837771.861960:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788837771.862590:0:6680:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a46f4bb480 x1875732254960640/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788837787 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837771.862608:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4bb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6680:1875732254960640:0@lo:5: 00000004:00080000:1.0:1788837771.862619:0:6680:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788837771.862652:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459204700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6680:1875732254960768:0@lo:700: 00000100:00100000:1.0:1788837771.862686:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837771.862709:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a46f4c4900 going to sleep for 11 seconds 00000100:00100000:3.0:1788837771.866361:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254960768 00000100:00100000:3.0:1788837771.866375:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254960768 00000100:00100000:3.0:1788837771.866438:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788837771.866449:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459206a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6680:x1875732254960768:12345-0@lo:700: 00000100:00100000:3.0:1788837771.866504:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ead2680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6659:1875732254960896:0@lo:700: 00000100:00100000:3.0:1788837771.866575:0:6659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837771.866629:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a345895e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837771.866696:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254960896 00000100:00100000:3.0:1788837771.866700:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254960896 00000100:00100000:3.0:1788837771.866739:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788837771.866748:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6659:x1875732254960896:12345-0@lo:700: 00000100:00080000:3.0:1788837771.867489:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 40000000:02000000:3.0:1788837771.921298:0:5815:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1788837771.933542:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6659:x1875732254960896:12345-0@lo:700: Request processed in 66786us (66957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837771.933575:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788837771.933641:0:6659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a46ead2680 x1875732254960896/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788837787 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837771.933656:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ead2680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6659:1875732254960896:0@lo:700: 40000000:02000000:2.0:1788837771.933668:0:6659:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1788837772.078825:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459206a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6680:x1875732254960768:12345-0@lo:700: Request processed in 212370us (216128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837772.078841:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788837772.078928:0:6680:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a459204700 x1875732254960768/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788837787 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837772.078945:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459204700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6680:1875732254960768:0@lo:700: 00000001:00080000:0.0:1788837772.079384:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1788837772.079402:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:1.0:1788837772.155098:0:6680:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1788837772.168316:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459204700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6680:1875732254961024:0@lo:5: 00000100:00100000:1.0:1788837772.168416:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837772.168469:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254961024 00000100:00100000:1.0:1788837772.168477:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254961024 00000100:00100000:1.0:1788837772.168531:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788837772.168552:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459206d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6680:x1875732254961024:12345-0@lo:5: 00000100:00100000:0.0:1788837772.170288:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a46f4c4e40 going to sleep for 11 seconds 00002000:00080000:0.0:1788837772.182931:0:6652:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788837772.182954:0:6652:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1788837772.193480:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459206d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6680:x1875732254961024:12345-0@lo:5: Request processed in 24921us (25055us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788837772.193493:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788837772.194878:0:6680:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a459204700 x1875732254961024/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788837788 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837772.194896:0:6680:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788837772.194912:0:6680:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff97a459204700 x1875732254961024/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788837788 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837772.194923:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459204700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6680:1875732254961024:0@lo:5: 00000004:00080000:3.0:1788837772.194937:0:6680:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1788837772.834878:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837773.869975:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837774.882304:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837775.906315:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837776.936321:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837777.061493:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3274:1875732254961152:0@lo:400: 00000100:00100000:0.0:1788837777.061596:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837777.061656:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788837777.061662:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254961536:0@lo:400: 00000100:00100000:0.0:1788837777.061695:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837777.061731:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732254961280:0@lo:400: 00000100:00100000:0.0:1788837777.061775:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837777.061817:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837777.061823:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732254961408:0@lo:400: 00000100:00100000:0.0:1788837777.061864:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837777.061899:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254961152 00000100:00100000:0.0:1788837777.061907:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254961152 00000100:00100000:0.0:1788837777.061956:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788837777.061966:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:3274:x1875732254961152:12345-0@lo:400: 00000100:00100000:0.0:1788837777.062018:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:3274:x1875732254961152:12345-0@lo:400: Request processed in 53us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837777.062025:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788837777.062071:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254961536 00000100:00100000:0.0:1788837777.062075:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254961536 00000100:00100000:0.0:1788837777.062111:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837777.062118:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3274:x1875732254961536:12345-0@lo:400: 00000100:00100000:0.0:1788837777.062153:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3274:x1875732254961536:12345-0@lo:400: Request processed in 36us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837777.062158:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837777.062180:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254961280 00000100:00100000:0.0:1788837777.062184:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254961280 00000100:00100000:0.0:1788837777.062231:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254961408 00000100:00100000:0.0:1788837777.062235:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254961408 00000100:00100000:0.0:1788837777.062813:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788837777.062822:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732254961280:12345-0@lo:400: 00000100:00100000:0.0:1788837777.062867:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732254961280:12345-0@lo:400: Request processed in 46us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837777.062873:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788837777.062885:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788837777.062892:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732254961408:12345-0@lo:400: 00000100:00100000:0.0:1788837777.062927:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732254961408:12345-0@lo:400: Request processed in 36us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837777.062933:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788837777.062981:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a46f4d2300 x1875732254961408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837777.062994:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732254961408:0@lo:400: 00010000:00080000:0.0:1788837777.063005:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a46f4d3480 x1875732254961280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837777.063014:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732254961280:0@lo:400: 00010000:00080000:0.0:1788837777.063048:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a46f4d2a00 x1875732254961536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837777.063069:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254961536:0@lo:400: 00000100:00100000:0.0:1788837777.063079:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3274:1875732254961152:0@lo:400: 00000100:00100000:0.0:1788837777.064790:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ead0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254961664:0@lo:13: 00000100:00100000:0.0:1788837777.064858:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837777.064963:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254961664 00000100:00100000:0.0:1788837777.064971:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254961664 00000100:00100000:0.0:1788837777.065020:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788837777.065027:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3274:x1875732254961664:12345-0@lo:13: 00002000:00000024:0.0:1788837777.065072:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837777.065116:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3274:x1875732254961664:12345-0@lo:13: Request processed in 89us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837777.065123:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788837777.065166:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a46ead0e00 x1875732254961664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837793 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837777.065196:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ead0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254961664:0@lo:13: 00000100:00080000:3.0:1788837777.066867:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788837777.066886:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788837777.133434:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:02000400:3.0:1788837777.932771:0:7021:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788837777.958555:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837778.981065:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837780.002649:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837781.026930:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837782.053912:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837782.184790:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254961792:0@lo:13: 00000100:00100000:0.0:1788837782.184863:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837782.184937:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254961792 00000100:00100000:0.0:1788837782.184944:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254961792 00000100:00100000:0.0:1788837782.185012:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788837782.185020:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254961792:12345-0@lo:13: 00002000:00000024:0.0:1788837782.185052:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837782.185091:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254961792:12345-0@lo:13: Request processed in 72us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837782.185097:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788837782.185117:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788837782.185143:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a46f4d2a00 x1875732254961792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837782.185153:0:3271:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788837782.185172:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254961792:0@lo:13: 00000100:00100000:0.0:1788837782.185247:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732254962048:0@lo:400: 00000100:00100000:0.0:1788837782.185272:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837782.185289:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788837782.185294:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732254962176:0@lo:400: 00000100:00100000:0.0:1788837782.185312:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837782.185335:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254962048 00000100:00100000:0.0:1788837782.185338:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254962048 00000100:00100000:0.0:1788837782.185374:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254962176 00000100:00100000:0.0:1788837782.185387:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254962176 00000100:00100000:0.0:1788837782.185408:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788837782.185413:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732254962048:12345-0@lo:400: 00000100:00100000:0.0:1788837782.185448:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732254962048:12345-0@lo:400: Request processed in 35us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837782.185453:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788837782.185464:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788837782.185469:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1875732254962176:12345-0@lo:400: 00000100:00100000:0.0:1788837782.185490:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1875732254962176:12345-0@lo:400: Request processed in 22us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837782.185495:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788837782.185515:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732254961920:0@lo:400: 00000100:00100000:0.0:1788837782.185544:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788837782.187608:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788837782.187664:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a46f4d1c00 x1875732254962176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837782.187680:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732254962176:0@lo:400: 00010000:00080000:0.0:1788837782.187692:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a46f4d2300 x1875732254962048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837782.187701:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732254962048:0@lo:400: 00000100:00100000:2.0:1788837782.188526:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254961920 00000100:00100000:2.0:1788837782.188536:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254961920 00000100:00100000:2.0:1788837782.188599:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788837782.188608:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a56a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:3272:x1875732254961920:12345-0@lo:400: 00000100:00100000:2.0:1788837782.188692:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a56a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:3272:x1875732254961920:12345-0@lo:400: Request processed in 85us (3146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837782.188699:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788837782.188746:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732254961920:0@lo:400: 00010000:00010000:0.0:1788837783.074362:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837784.100407:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837785.122608:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837786.148909:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837787.172289:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837787.298340:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788837787.298367:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732254962304:0@lo:400: 00000100:00100000:0.0:1788837787.298445:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837787.298523:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254962304 00000100:00100000:0.0:1788837787.298530:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254962304 00000100:00100000:0.0:1788837787.298576:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788837787.298585:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a56b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:3272:x1875732254962304:12345-0@lo:400: 00000100:00100000:0.0:1788837787.298638:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a56b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:3272:x1875732254962304:12345-0@lo:400: Request processed in 54us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837787.298644:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788837787.298696:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732254962304:0@lo:400: 00000100:00100000:0.0:1788837787.298751:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732254962560:0@lo:400: 00000100:00100000:0.0:1788837787.298779:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837787.298813:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254962560 00000100:00100000:0.0:1788837787.298817:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254962560 00000100:00100000:0.0:1788837787.298850:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788837787.298868:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1875732254962560:12345-0@lo:400: 00000100:00100000:0.0:1788837787.298908:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1875732254962560:12345-0@lo:400: Request processed in 51us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837787.298914:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788837787.298931:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788837787.298966:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a46f4d1c00 x1875732254962560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837787.298978:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732254962560:0@lo:400: 00000100:00100000:0.0:1788837787.298995:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3272:1875732254962432:0@lo:400: 00000100:00100000:0.0:1788837787.299019:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837787.299178:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254962432 00000100:00100000:0.0:1788837787.299182:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254962432 00000100:00100000:0.0:1788837787.299232:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788837787.299247:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1875732254962432:12345-0@lo:400: 00000100:00100000:0.0:1788837787.299283:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1875732254962432:12345-0@lo:400: Request processed in 38us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837787.299289:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788837787.299315:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a46f4d2300 x1875732254962432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837787.299324:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3272:1875732254962432:0@lo:400: 00000100:00100000:0.0:1788837787.299361:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254962688:0@lo:400: 00000100:00100000:0.0:1788837787.299388:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837787.299417:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254962688 00000100:00100000:0.0:1788837787.299421:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254962688 00000100:00100000:0.0:1788837787.299453:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788837787.299460:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254962688:12345-0@lo:400: 00000100:00100000:0.0:1788837787.299491:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254962688:12345-0@lo:400: Request processed in 32us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837787.299497:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788837787.299514:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788837787.299529:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a46f4d2300 x1875732254962688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837787.299538:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254962688:0@lo:400: 00000100:00100000:2.0:1788837787.299801:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459204700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254962816:0@lo:13: 00000100:00100000:2.0:1788837787.299833:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837787.299909:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254962816 00000100:00100000:1.0:1788837787.299913:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254962816 00000100:00100000:1.0:1788837787.299951:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788837787.299957:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254962816:12345-0@lo:13: 00002000:00000024:1.0:1788837787.299984:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837787.300021:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254962816:12345-0@lo:13: Request processed in 64us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837787.300028:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788837787.300062:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a459204700 x1875732254962816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837787.300075:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459204700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254962816:0@lo:13: 00010000:00010000:3.0:1788837788.194487:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837789.223217:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837790.242798:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788837790.342768:0:7591:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788837790.342776:0:7591:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788837790.343176:0:7591:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97a3451f4000 00000020:01000004:0.0:1788837790.343199:0:7591:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788837790.343391:0:7591:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788837790.343412:0:7591:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff97a46f4d99b8) 00000020:00000080:0.0:1788837790.343435:0:7591:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788837790.364476:0:7591:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788837790.364943:0:7591:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788837790.399534:0:7591:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788837790.406152:0:7591:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788837790.406192:0:7591:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788837790.406383:0:7591:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788837790.406411:0:7591:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788837790.407388:0:7591:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788837790.407407:0:7591:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788837790.407424:0:7591:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2deb895b363e61ea 00000020:01000004:3.0:1788837790.407436:0:7591:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788837790.407465:0:7591:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.154@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788837790.407469:0:7591:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788837790.407476:0:7591:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788837790.407510:0:7591:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788837790.407515:0:7591:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788837790.457765:0:7591:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788837790.457817:0:7591:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.154@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788837790.457822:0:7591:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788837790.457824:0:7591:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788837790.457828:0:7591:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788837790.457829:0:7591:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788837790.457831:0:7591:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788837790.457832:0:7591:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788837790.457833:0:7591:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788837790.457835:0:7591:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788837790.457836:0:7591:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788837790.457838:0:7591:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788837790.457840:0:7591:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788837790.457843:0:7591:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788837790.457845:0:7591:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788837790.457847:0:7591:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788837790.457848:0:7591:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788837790.457849:0:7591:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788837790.457850:0:7591:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788837790.457851:0:7591:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788837790.457852:0:7591:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788837790.457853:0:7591:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788837790.457854:0:7591:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788837790.457855:0:7591:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788837790.457856:0:7591:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788837790.457882:0:7591:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788837790.457898:0:7591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ead1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254962944:0@lo:253: 00000100:00100000:3.0:1788837790.457964:0:7591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837790.458068:0:7591:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a46f4c4540 going to sleep for 11 seconds 00000100:00100000:0.0:1788837790.458180:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254962944 00000100:00100000:0.0:1788837790.458187:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254962944 00000100:00100000:0.0:1788837790.458385:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788837790.458395:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:7591:x1875732254962944:12345-0@lo:253: 20000000:01000000:0.0:1788837790.458428:0:5800:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788837790.458433:0:5800:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788837790.458438:0:5800:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788837790.458442:0:5800:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788837790.459782:0:5800:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788837790.460017:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1788837790.460033:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788837790.460075:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1788837790.460083:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788837790.460114:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1788837790.460166:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1788837790.460841:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1788837790.460863:0:5800:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.154@tcp 20000000:01000000:1.0:1788837790.460865:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.154@tcp (null) (null) (null) 00000040:00080000:1.0:1788837790.460914:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1788837790.460923:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788837790.460968:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1788837790.460977:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.154@tcp (null) (null) 00000040:00080000:1.0:1788837790.461009:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1788837790.461018:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788837790.461048:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1788837790.461109:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1788837790.462124:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1788837790.462145:0:5800:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.154@tcp 20000000:01000000:1.0:1788837790.462146:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.154@tcp (null) (null) (null) 00000040:00080000:1.0:1788837790.462177:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1788837790.462184:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788837790.462292:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1788837790.462300:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.154@tcp (null) (null) 00000040:00080000:1.0:1788837790.462327:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1788837790.462333:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788837790.462375:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1788837790.462411:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1788837790.462426:0:5800:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788837790.462429:0:5800:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788837790.462433:0:5800:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788837790.462445:0:5800:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788837790.462448:0:5800:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788837790.462483:0:5800:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788837790.462486:0:5800:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788837790.463474:0:7593:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1788837790.463542:0:7593:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1788837790.463604:0:7593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788837790.464044:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788837790.464087:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788837790.464145:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1788837790.464160:0:5800:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788837790.464163:0:5800:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788837790.464693:0:7594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788837790.464896:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788837790.464931:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788837790.464987:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788837790.465008:0:5800:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788837790.465010:0:5800:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788837790.465748:0:7595:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1788837790.465807:0:7595:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1788837790.465859:0:7595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788837790.466114:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1788837790.466441:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1788837790.466483:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1788837790.466498:0:5800:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788837790.466500:0:5800:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788837790.467062:0:7596:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1788837790.467139:0:7596:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1788837790.467190:0:7596:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1788837790.467670:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1788837790.467710:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1788837790.467789:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1788837790.467823:0:5800:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1788837790.467827:0:5800:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1788837790.467838:0:5800:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788837790.467858:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a441666e00/0x2deb895b363e61f1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.467877:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a441521800/0x2deb895b363e6142 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e613b expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.467884:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a440030a00/0x2deb895b363e616c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e6165 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.467892:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a440030600/0x2deb895b363e6196 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e618f expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.467898:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a441464600/0x2deb895b363e61b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e61ab expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.467904:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a441464e00/0x2deb895b363e61d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e61ce expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.467987:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a441666e00/0x2deb895b363e61f1 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.468026:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a441464e00/0x2deb895b363e61d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e61ce expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.468040:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a441464e00/0x2deb895b363e61d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e61ce expref: 16 pid: 5803 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837790.468054:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459204700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5800:1875732254963072:0@lo:104: 00000100:00100000:1.0:1788837790.468124:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788837790.468240:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a441464600/0x2deb895b363e61b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e61ab expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.468250:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a441464600/0x2deb895b363e61b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e61ab expref: 16 pid: 5802 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837790.468258:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459207b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5800:1875732254963200:0@lo:104: 00010000:00010000:1.0:1788837790.468284:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a440030600/0x2deb895b363e6196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e618f expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.468292:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a440030600/0x2deb895b363e6196 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e618f expref: 16 pid: 5802 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837790.468299:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459204e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5800:1875732254963328:0@lo:104: 00010000:00010000:1.0:1788837790.468325:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a440030a00/0x2deb895b363e616c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e6165 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.468333:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a440030a00/0x2deb895b363e616c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e6165 expref: 16 pid: 5803 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837790.468341:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459207800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5800:1875732254963456:0@lo:104: 00010000:00010000:1.0:1788837790.468360:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a441521800/0x2deb895b363e6142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e613b expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.468367:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a441521800/0x2deb895b363e6142 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e613b expref: 16 pid: 5803 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837790.468374:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459205880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5800:1875732254963584:0@lo:104: 00000100:00100000:1.0:1788837790.468394:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4496f8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837790.471598:0:5792:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788837790.471649:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837790.471694:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837790.471707:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837790.471728:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254963072 00000100:00100000:2.0:1788837790.471739:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254963072 00000100:00100000:0.0:1788837790.471752:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837790.471767:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254963200 00000100:00100000:0.0:1788837790.471772:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254963200 00000100:00100000:2.0:1788837790.471783:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254963328 00000100:00100000:2.0:1788837790.471789:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254963328 00000100:00100000:0.0:1788837790.471810:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254963456 00000100:00100000:0.0:1788837790.471814:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254963456 00000100:00100000:2.0:1788837790.471822:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254963584 00000100:00100000:2.0:1788837790.471827:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254963584 00000100:00100000:0.0:1788837790.471838:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788837790.471849:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a475559050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+7:5800:x1875732254963072:12345-0@lo:104: 00010000:00010000:0.0:1788837790.471867:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a441465e00/0x2deb895b363e61ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e61d5 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837790.472020:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788837790.472027:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a475559050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+7:5800:x1875732254963072:12345-0@lo:104: Request processed in 181us (3903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837790.472159:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788837790.472194:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459204700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5800:1875732254963072:0@lo:104: 00000100:00100000:0.0:1788837790.472226:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788837790.472234:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+6:5800:x1875732254963200:12345-0@lo:104: 00010000:00010000:0.0:1788837790.472250:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a441520400/0x2deb895b363e61ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e61b2 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837790.472303:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788837790.472308:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+6:5800:x1875732254963200:12345-0@lo:104: Request processed in 77us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837790.472314:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788837790.472328:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788837790.472334:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+5:5800:x1875732254963328:12345-0@lo:104: 00010000:00010000:0.0:1788837790.472342:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a441666200/0x2deb895b363e618f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e6196 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837790.472370:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788837790.472375:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+5:5800:x1875732254963328:12345-0@lo:104: Request processed in 42us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837790.472381:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788837790.472394:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788837790.472399:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+4:5800:x1875732254963456:12345-0@lo:104: 00010000:00010000:0.0:1788837790.472406:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a441520a00/0x2deb895b363e6165 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e616c expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837790.472427:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788837790.472431:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+4:5800:x1875732254963456:12345-0@lo:104: Request processed in 34us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837790.472436:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788837790.472446:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788837790.472452:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+3:5800:x1875732254963584:12345-0@lo:104: 00010000:00010000:0.0:1788837790.472466:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a441465a00/0x2deb895b363e613b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e6142 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837790.472492:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788837790.472496:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+3:5800:x1875732254963584:12345-0@lo:104: Request processed in 45us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837790.472502:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788837790.472520:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788837790.472525:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a441465e00/0x2deb895b363e61ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e61d5 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837790.472532:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441465e00 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:0.0:1788837790.472536:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a441465e00/0x2deb895b363e61ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e61d5 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837790.472546:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a441465e00/0x2deb895b363e61ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e61d5 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837790.472553:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a441465e00/0x2deb895b363e61ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e61d5 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837790.472559:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788837790.472600:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a441465e00/0x2deb895b363e61ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e61d5 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837790.472607:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837790.472628:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a441465e00/0x2deb895b363e61ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e61d5 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837790.472635:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a441465e00/0x2deb895b363e61ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e61d5 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837790.472655:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788837790.472659:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a441520400/0x2deb895b363e61ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e61b2 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837790.472664:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441520400 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:0.0:1788837790.472667:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a441520400/0x2deb895b363e61ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e61b2 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837790.472673:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a441520400/0x2deb895b363e61ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e61b2 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837790.472679:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a441520400/0x2deb895b363e61ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e61b2 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837790.472683:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788837790.472707:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a441520400/0x2deb895b363e61ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e61b2 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837790.472713:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837790.472726:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a441520400/0x2deb895b363e61ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e61b2 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837790.472732:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a441520400/0x2deb895b363e61ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e61b2 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837790.472741:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788837790.472745:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a441666200/0x2deb895b363e618f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e6196 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837790.472761:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441666200 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:0.0:1788837790.472764:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a441666200/0x2deb895b363e618f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e6196 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837790.472770:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a441666200/0x2deb895b363e618f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e6196 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837790.472776:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a441666200/0x2deb895b363e618f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e6196 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837790.472780:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788837790.472791:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a441666200/0x2deb895b363e618f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e6196 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.472842:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788837790.473069:0:7597:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837790.473075:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a441520a00/0x2deb895b363e6165 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e616c expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.473082:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441520a00 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:1.0:1788837790.473084:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a441520a00/0x2deb895b363e6165 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e616c expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.473090:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a441520a00/0x2deb895b363e6165 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e616c expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837790.473096:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a441520a00/0x2deb895b363e6165 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e616c expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837790.473100:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837790.473113:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a441520a00/0x2deb895b363e6165 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e616c expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.473118:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837790.473123:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a441520a00/0x2deb895b363e6165 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e616c expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.473128:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a441520a00/0x2deb895b363e6165 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e616c expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.473139:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837790.473141:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837790.473142:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837790.473242:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837790.473253:0:7597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a441465a00/0x2deb895b363e613b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e6142 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.473260:0:7597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441465a00 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:1.0:1788837790.473262:0:7597:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a441465a00/0x2deb895b363e613b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e6142 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.473269:0:7597:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a441465a00/0x2deb895b363e613b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e6142 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837790.473275:0:7597:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a441465a00/0x2deb895b363e613b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e6142 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837790.473280:0:7597:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837790.473293:0:7597:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a441465a00/0x2deb895b363e613b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e6142 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.473298:0:7597:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837790.473303:0:7597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a441465a00/0x2deb895b363e613b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e6142 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.473309:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a441465a00/0x2deb895b363e613b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e6142 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.473318:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837790.473319:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837790.473321:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837790.473326:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837790.473327:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837790.473367:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837790.473373:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a441666200/0x2deb895b363e618f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e6196 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837790.473379:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a441666200/0x2deb895b363e618f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e6196 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837790.473396:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837790.473397:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837790.473399:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837790.473413:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732254963712:0@lo:103: 00000100:00100000:0.0:1788837790.473450:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837790.473520:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732254963968:0@lo:103: 00000100:00100000:0.0:1788837790.473541:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837790.473621:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788837790.473627:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459207b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5800:1875732254963200:0@lo:104: 00000100:00100000:0.0:1788837790.473627:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459206300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732254964224:0@lo:103: 00000100:00100000:3.0:1788837790.473637:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459204e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5800:1875732254963328:0@lo:104: 00000100:00100000:0.0:1788837790.473647:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837790.473654:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459207800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5800:1875732254963456:0@lo:104: 00000100:00100000:3.0:1788837790.473661:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459205880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5800:1875732254963584:0@lo:104: 00000100:00100000:1.0:1788837790.473670:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254963712 00000100:00100000:1.0:1788837790.473674:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254963712 00010000:00010000:3.0:1788837790.473689:0:5800:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a441666e00/0x2deb895b363e61f1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.473698:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a441464e00/0x2deb895b363e61d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e61ce expref: 17 pid: 5803 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837790.473726:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254963968 00000100:00100000:1.0:1788837790.473729:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254963968 00010000:00010000:1.0:1788837790.473741:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a440030600/0x2deb895b363e6196 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e618f expref: 18 pid: 5802 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837790.473754:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788837790.473761:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:3272:x1875732254963712:12345-0@lo:103: 00010000:00010000:1.0:1788837790.473772:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837790.473776:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a441464e00/0x2deb895b363e61d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e61ce expref: 18 pid: 5803 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.473785:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a441464e00/0x2deb895b363e61d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e61ce expref: 18 pid: 5803 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.473809:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a441464e00/0x2deb895b363e61d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e61ce expref: 18 pid: 5803 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.473822:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837790.473847:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:3272:x1875732254963712:12345-0@lo:103: Request processed in 87us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837790.473853:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788837790.473864:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788837790.473869:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:3272:x1875732254963968:12345-0@lo:103: 00010000:00010000:1.0:1788837790.473875:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837790.473879:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a440030600/0x2deb895b363e6196 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e618f expref: 16 pid: 5802 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.473894:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a440030600/0x2deb895b363e6196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e618f expref: 16 pid: 5802 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.473903:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a440030600/0x2deb895b363e6196 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e618f expref: 16 pid: 5802 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.473923:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837790.473942:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:3272:x1875732254963968:12345-0@lo:103: Request processed in 73us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837790.473947:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788837790.474080:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732254963712:0@lo:103: 00000100:00100000:0.0:1788837790.474088:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732254963968:0@lo:103: 00000100:00100000:0.0:1788837790.474109:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732254963840:0@lo:103: 00000100:00100000:0.0:1788837790.474129:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837790.474184:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788837790.474189:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459204000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732254964096:0@lo:103: 00000100:00100000:0.0:1788837790.474225:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837790.474259:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254964224 00000100:00100000:1.0:1788837790.474263:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254964224 00000100:00100000:2.0:1788837790.474272:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254963840 00000100:00100000:2.0:1788837790.474278:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254963840 00010000:00010000:1.0:1788837790.474279:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a441521800/0x2deb895b363e6142 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e613b expref: 15 pid: 5803 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837790.474299:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1788837790.474301:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a441464600/0x2deb895b363e61b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e61ab expref: 16 pid: 5802 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837790.474308:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:3272:x1875732254964224:12345-0@lo:103: 00010000:00010000:1.0:1788837790.474319:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837790.474324:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a441521800/0x2deb895b363e6142 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e613b expref: 16 pid: 5803 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837790.474327:0:5794:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788837790.474336:0:5794:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1788837790.474341:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a441521800/0x2deb895b363e6142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e613b expref: 16 pid: 5803 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.474353:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a441521800/0x2deb895b363e6142 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e613b expref: 16 pid: 5803 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.474363:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837790.474401:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:3272:x1875732254964224:12345-0@lo:103: Request processed in 95us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837790.474413:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788837790.474426:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788837790.474431:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:3273:x1875732254963840:12345-0@lo:103: 00010000:00010000:1.0:1788837790.474452:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837790.474457:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a441464600/0x2deb895b363e61b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e61ab expref: 14 pid: 5802 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.474467:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a441464600/0x2deb895b363e61b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e61ab expref: 14 pid: 5802 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.474476:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a441464600/0x2deb895b363e61b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e61ab expref: 14 pid: 5802 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.474488:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837790.474515:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:3273:x1875732254963840:12345-0@lo:103: Request processed in 84us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837790.474517:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459206300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732254964224:0@lo:103: 00000100:00100000:1.0:1788837790.474528:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788837790.474635:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732254963840:0@lo:103: 00000100:00100000:1.0:1788837790.474678:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254964096 00000100:00100000:1.0:1788837790.474683:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254964096 00010000:00010000:1.0:1788837790.474696:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a440030a00/0x2deb895b363e616c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e6165 expref: 13 pid: 5803 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837790.474710:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788837790.474716:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:3273:x1875732254964096:12345-0@lo:103: 00010000:00010000:1.0:1788837790.474723:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837790.474727:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a440030a00/0x2deb895b363e616c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e6165 expref: 13 pid: 5803 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.474734:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a440030a00/0x2deb895b363e616c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e6165 expref: 13 pid: 5803 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.474751:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a440030a00/0x2deb895b363e616c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e6165 expref: 13 pid: 5803 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.474763:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a441666e00/0x2deb895b363e61f1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.474771:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a441666e00/0x2deb895b363e61f1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.474784:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a441666e00/0x2deb895b363e61f1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.474790:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a441666e00/0x2deb895b363e61f1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.474807:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a441666e00/0x2deb895b363e61f1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.474815:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a441666e00/0x2deb895b363e61f1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.474821:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441666e00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:1.0:1788837790.474825:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a441666e00/0x2deb895b363e61f1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.474833:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a441666e00/0x2deb895b363e61f1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.474852:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a441666e00/0x2deb895b363e61f1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.474870:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837790.474899:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:3273:x1875732254964096:12345-0@lo:103: Request processed in 183us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837790.474905:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788837790.475004:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459204000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732254964096:0@lo:103: 00010000:00010000:3.0:1788837790.475935:0:5800:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97a441666e00/0x2deb895b363e61f1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837790.475948:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a441666e00/0x2deb895b363e61f1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837790.475955:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a441666e00/0x2deb895b363e61f1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788837790.475972:0:5800:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788837790.600903:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+11:7591:x1875732254962944:12345-0@lo:253: Request processed in 142494us (142922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837790.600921:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788837790.601270:0:7591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ead1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254962944:0@lo:253: 10000000:01000000:0.0:1788837790.601291:0:7591:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788837790.601294:0:7591:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788837790.601296:0:7591:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788837790.601298:0:7591:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837790.601299:0:7591:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788837790.601300:0:7591:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837790.601302:0:7591:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837790.601304:0:7591:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788837790.601306:0:7591:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788837790.601307:0:7591:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837790.601309:0:7591:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788837790.601337:0:7591:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97a3451f4000 from lustre-OST0001 10000000:01000000:0.0:1788837790.601372:0:7591:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788837790.601375:0:7591:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788837790.601386:0:7591:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97a448f399b8 local copy 10000000:01000000:0.0:1788837790.601390:0:7591:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788837790.601475:0:7591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a440031a00/0x2deb895b363e61f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837790.601487:0:7591:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.154@tcp lock: ffff97a440031a00/0x2deb895b363e61f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837790.601498:0:7591:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a440031a00/0x2deb895b363e61f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837790.601521:0:7591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c93100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254964352:0@lo:101: 00000100:00100000:0.0:1788837790.601569:0:7591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837790.601632:0:7591:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4618bb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837790.601945:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254964352 00000100:00100000:1.0:1788837790.601954:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254964352 00000100:00100000:1.0:1788837790.602128:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788837790.602141:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+11:7591:x1875732254964352:12345-0@lo:101: 00010000:00010000:1.0:1788837790.602158:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837790.602178:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a441666e00/0x2deb895b363e61ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e61f8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.602247:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a441666e00/0x2deb895b363e61ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e61f8 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.602260:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a441666e00/0x2deb895b363e61ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e61f8 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.602269:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a441666e00, rc 0) 00000100:00100000:1.0:1788837790.602319:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:7591:x1875732254964352:12345-0@lo:101: Request processed in 182us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837790.602326:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788837790.602435:0:7591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c93100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254964352:0@lo:101: 00010000:00010000:3.0:1788837790.602454:0:7591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a440031a00/0x2deb895b363e61f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2deb895b363e61ff expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837790.602464:0:7591:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a440031a00/0x2deb895b363e61f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2deb895b363e61ff expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837790.602591:0:7591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ead2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254964480:0@lo:501: 00000100:00100000:3.0:1788837790.602627:0:7591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837790.602664:0:7591:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a46f4c4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788837790.602780:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254964480 00000100:00100000:1.0:1788837790.602786:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254964480 00000100:00100000:1.0:1788837790.602831:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788837790.602840:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:7591:x1875732254964480:12345-0@lo:501: 00000100:00100000:1.0:1788837790.603111:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:7591:x1875732254964480:12345-0@lo:501: Request processed in 272us (483us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788837790.603127:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788837790.603160:0:7591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ead2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254964480:0@lo:501: 10000000:01000000:1.0:1788837790.603177:0:7591:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788837790.603242:0:7591:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788837790.603248:0:7591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a440031a00/0x2deb895b363e61f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2deb895b363e61ff expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.603257:0:7591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a440031a00/0x2deb895b363e61f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2deb895b363e61ff expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.603265:0:7591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff97a440031a00/0x2deb895b363e61f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2deb895b363e61ff expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.603285:0:7591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788837790.603310:0:7591:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97a3451f4000 10000000:01000000:1.0:1788837790.603316:0:7591:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788837790.603322:0:7591:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788837790.603325:0:7591:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788837790.603331:0:7591:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788837790.603334:0:7591:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788837790.603358:0:7591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441666200/0x2deb895b363e6206 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.603367:0:7591:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a441666200/0x2deb895b363e6206 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.603377:0:7591:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a441666200/0x2deb895b363e6206 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837790.603403:0:7591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459207100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254964608:0@lo:101: 00000100:00100000:1.0:1788837790.603672:0:7591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837790.603695:0:7591:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4496f8240 going to sleep for 11 seconds 00010000:00010000:1.0:1788837790.603715:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837790.603722:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a440031a00/0x2deb895b363e61f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2deb895b363e61ff expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.603730:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a440031a00 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:1.0:1788837790.603735:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a440031a00/0x2deb895b363e61f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2deb895b363e61ff expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.603745:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a440031a00/0x2deb895b363e61f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x2deb895b363e61ff expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837790.603753:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a440031a00/0x2deb895b363e61f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x2deb895b363e61ff expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837790.603759:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837790.603779:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a440031a00/0x2deb895b363e61f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2deb895b363e61ff expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.603786:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837790.603828:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a440031a00/0x2deb895b363e61f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2deb895b363e61ff expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.603836:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a440031a00/0x2deb895b363e61f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2deb895b363e61ff expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.603855:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837790.603866:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837790.603868:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837790.603882:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459204380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732254964736:0@lo:103: 00000100:00100000:1.0:1788837790.603912:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837790.604055:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254964736 00000100:00100000:1.0:1788837790.604063:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254964736 00000100:00100000:1.0:1788837790.604103:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788837790.604110:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459205500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:3273:x1875732254964736:12345-0@lo:103: 00010000:00010000:1.0:1788837790.604123:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837790.604138:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a441666e00/0x2deb895b363e61ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2deb895b363e61f8 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.604154:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837790.604180:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459205500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+11:3273:x1875732254964736:12345-0@lo:103: Request processed in 70us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837790.604187:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788837790.604249:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459204380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732254964736:0@lo:103: 00000100:00100000:1.0:1788837790.604274:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254964608 00000100:00100000:1.0:1788837790.604278:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254964608 00000100:00100000:1.0:1788837790.604292:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788837790.604296:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+11:7591:x1875732254964608:12345-0@lo:101: 00010000:00010000:1.0:1788837790.604305:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837790.604318:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a441667e00/0x2deb895b363e620d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e6206 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.604334:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a441667e00/0x2deb895b363e620d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e6206 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.604344:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a441667e00/0x2deb895b363e620d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e6206 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.604357:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a441667e00, rc 0) 00000100:00100000:1.0:1788837790.604384:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:7591:x1875732254964608:12345-0@lo:101: Request processed in 88us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837790.604389:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788837790.604486:0:7591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459207100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254964608:0@lo:101: 00010000:00010000:1.0:1788837790.604501:0:7591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a441666200/0x2deb895b363e6206 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e620d expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.604510:0:7591:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a441666200/0x2deb895b363e6206 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e620d expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837790.604610:0:7591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459207100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254964864:0@lo:501: 00000100:00100000:1.0:1788837790.604639:0:7591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837790.604657:0:7591:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4496f8240 going to sleep for 11 seconds 00000100:00100000:1.0:1788837790.604678:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254964864 00000100:00100000:1.0:1788837790.604682:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254964864 00000100:00100000:1.0:1788837790.604700:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788837790.604705:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a56bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:7591:x1875732254964864:12345-0@lo:501: 00000100:00100000:0.0:1788837790.605892:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a56bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:7591:x1875732254964864:12345-0@lo:501: Request processed in 1179us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837790.605907:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788837790.606132:0:7591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459207100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254964864:0@lo:501: 00000100:00100000:1.0:1788837790.606185:0:7591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459207100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254964992:0@lo:503: 00000100:00100000:1.0:1788837790.606263:0:7591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837790.606359:0:7591:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4496f8240 going to sleep for 11 seconds 00000100:00100000:3.0:1788837790.606487:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254964992 00000100:00100000:3.0:1788837790.606503:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254964992 00000100:00100000:3.0:1788837790.606597:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788837790.606606:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:7591:x1875732254964992:12345-0@lo:503: 00000100:00100000:3.0:1788837790.606836:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:7591:x1875732254964992:12345-0@lo:503: Request processed in 231us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837790.606844:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788837790.606924:0:7591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459207100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254964992:0@lo:503: 00000040:00080000:1.0:1788837790.607377:0:7591:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788837790.609324:0:7591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459207100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254965120:0@lo:502: 00000100:00100000:1.0:1788837790.609454:0:7591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837790.609883:0:7591:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4496f8240 going to sleep for 11 seconds 00000100:00100000:0.0:1788837790.610369:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254965120 00000100:00100000:0.0:1788837790.610382:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254965120 00000100:00100000:0.0:1788837790.610526:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788837790.610537:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a56b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:7591:x1875732254965120:12345-0@lo:502: 00000100:00100000:0.0:1788837790.610942:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a56b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:7591:x1875732254965120:12345-0@lo:502: Request processed in 405us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837790.610952:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788837790.611103:0:7591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459207100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254965120:0@lo:502: 00000040:00080000:1.0:1788837790.611528:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788837790.611592:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788837790.611627:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788837790.611675:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788837790.611714:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788837790.611747:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788837790.611816:0:7591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459207100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254965248:0@lo:502: 00000100:00100000:1.0:1788837790.611883:0:7591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837790.611922:0:7591:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4496f8240 going to sleep for 11 seconds 00000100:00100000:0.0:1788837790.612238:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254965248 00000100:00100000:0.0:1788837790.612248:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254965248 00000100:00100000:0.0:1788837790.612284:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788837790.612294:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:7591:x1875732254965248:12345-0@lo:502: 00000100:00100000:0.0:1788837790.612599:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:7591:x1875732254965248:12345-0@lo:502: Request processed in 305us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837790.612607:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788837790.612852:0:7591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459207100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254965248:0@lo:502: 00000040:00080000:0.0:1788837790.613358:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788837790.613373:0:7591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1788837790.614276:0:7601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788837790.614290:0:7601:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788837790.614299:0:7601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837790.614302:0:7601:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788837790.614310:0:7601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788837790.614353:0:7601:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff97a458ce4d28) 00000020:00000080:0.0:1788837790.614386:0:7601:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788837790.614396:0:7601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788837790.614585:0:7601:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a3451f4000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788837790.614595:0:7601:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788837790.614614:0:7601:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2deb895b363e621b 00010000:00010000:0.0:1788837790.620560:0:7601:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1788837790.621478:0:7601:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788837790.624685:0:7601:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788837790.628858:0:7601:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1788837790.637490:0:7601:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788837790.638402:0:7601:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788837790.640172:0:7601:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788837790.640197:0:7601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837790.640240:0:7601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837790.640243:0:7601:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788837790.640247:0:7601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837790.640252:0:7601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837790.640253:0:7601:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788837790.640256:0:7601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788837790.640258:0:7601:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788837790.640352:0:7601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837790.640357:0:7601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837790.640358:0:7601:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788837790.640362:0:7601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788837790.640730:0:7591:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788837790.640768:0:7591:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788837790.640809:0:7591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441666200/0x2deb895b363e6206 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e620d expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.640831:0:7591:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a441666200/0x2deb895b363e6206 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e620d expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837790.640841:0:7591:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a3451f4000 from 1 10000000:01000000:1.0:1788837790.640845:0:7591:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788837790.640911:0:7591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441666e00/0x2deb895b363e6222 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.640920:0:7591:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a441666e00/0x2deb895b363e6222 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.640956:0:7591:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a441666e00/0x2deb895b363e6222 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837790.640998:0:7591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459207100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254965376:0@lo:101: 00000100:00100000:1.0:1788837790.641095:0:7591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837790.641139:0:7591:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4496f89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837790.641350:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254965376 00000100:00100000:0.0:1788837790.641368:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254965376 00000100:00100000:0.0:1788837790.641433:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788837790.641452:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:7591:x1875732254965376:12345-0@lo:101: 00010000:00010000:0.0:1788837790.641475:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837790.641497:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a440030c00/0x2deb895b363e6229 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e6222 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837790.641534:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a440030c00/0x2deb895b363e6229 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e6222 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837790.641546:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a440030c00/0x2deb895b363e6229 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e6222 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837790.641556:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a440030c00, rc 0) 00000100:00100000:0.0:1788837790.641619:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:7591:x1875732254965376:12345-0@lo:101: Request processed in 169us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837790.641632:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788837790.644613:0:7591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459207100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254965376:0@lo:101: 00010000:00010000:1.0:1788837790.644654:0:7591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a441666e00/0x2deb895b363e6222 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6229 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.644671:0:7591:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a441666e00/0x2deb895b363e6222 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e6229 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837790.644861:0:7591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459207100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254965504:0@lo:501: 00000100:00100000:1.0:1788837790.644941:0:7591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837790.645002:0:7591:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4496f89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837790.648126:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254965504 00000100:00100000:2.0:1788837790.648150:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254965504 00000100:00100000:2.0:1788837790.648242:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788837790.648254:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:7591:x1875732254965504:12345-0@lo:501: 00000100:00100000:2.0:1788837790.649427:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:7591:x1875732254965504:12345-0@lo:501: Request processed in 1168us (4479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837790.649442:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788837790.650091:0:7591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459207100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254965504:0@lo:501: 00000100:00100000:1.0:1788837790.650164:0:7591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459207100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254965632:0@lo:503: 00000100:00100000:1.0:1788837790.650449:0:7591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837790.650536:0:7591:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4496f89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837790.652703:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254965632 00000100:00100000:3.0:1788837790.652719:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254965632 00000100:00100000:3.0:1788837790.652838:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788837790.652851:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:7591:x1875732254965632:12345-0@lo:503: 00000100:00100000:3.0:1788837790.653397:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:7591:x1875732254965632:12345-0@lo:503: Request processed in 546us (2945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837790.653407:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788837790.653547:0:7591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459207100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254965632:0@lo:503: 00000040:00080000:1.0:1788837790.653924:0:7591:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788837790.654026:0:7591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459207100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254965760:0@lo:502: 00000100:00100000:1.0:1788837790.654086:0:7591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837790.654701:0:7591:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4496f89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837790.654752:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254965760 00000100:00100000:0.0:1788837790.654761:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254965760 00000100:00100000:3.0:1788837790.654833:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788837790.654846:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:7591:x1875732254965760:12345-0@lo:502: 00000100:00100000:3.0:1788837790.655245:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:7591:x1875732254965760:12345-0@lo:502: Request processed in 400us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837790.655253:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788837790.655555:0:7591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459207100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254965760:0@lo:502: 00000040:00080000:1.0:1788837790.655910:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788837790.656004:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788837790.656045:0:7591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459207100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254965888:0@lo:502: 00000100:00100000:1.0:1788837790.656107:0:7591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837790.656142:0:7591:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4496f89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837790.656386:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254965888 00000100:00100000:2.0:1788837790.656395:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254965888 00000100:00100000:2.0:1788837790.656440:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788837790.656450:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:7591:x1875732254965888:12345-0@lo:502: 00000100:00100000:2.0:1788837790.656661:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:7591:x1875732254965888:12345-0@lo:502: Request processed in 211us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837790.656679:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788837790.656821:0:7591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459207100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254965888:0@lo:502: 00000040:00080000:1.0:1788837790.657088:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788837790.657103:0:7591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788837790.657686:0:7605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788837790.657699:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837790.657702:0:7605:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788837790.657708:0:7605:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a3451f4000 00000020:00000080:1.0:1788837790.657711:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788837790.657729:0:7605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788837790.657732:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837790.657734:0:7605:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788837790.657737:0:7605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788837790.658349:0:7591:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788837790.658374:0:7591:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788837790.658421:0:7591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441666e00/0x2deb895b363e6222 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6229 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837790.658435:0:7591:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a441666e00/0x2deb895b363e6222 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6229 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837790.658503:0:7591:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788837790.658506:0:7591:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97a3451f4000 10000000:01000000:2.0:1788837790.658511:0:7591:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97a3451f4000 10000000:01000000:2.0:1788837790.658516:0:7591:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788837790.658523:0:7591:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97a3451f4000 from 1 10000000:01000000:2.0:1788837790.658526:0:7591:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788837790.658570:0:7591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6230 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837790.658578:0:7591:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6230 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837790.658589:0:7591:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6230 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837790.658616:0:7591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254966016:0@lo:101: 00000100:00100000:2.0:1788837790.658705:0:7591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837790.658752:0:7591:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4474ead80 going to sleep for 11 seconds 00000100:00100000:1.0:1788837790.658818:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254966016 00000100:00100000:1.0:1788837790.658827:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254966016 00000100:00100000:1.0:1788837790.658877:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788837790.658888:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:7591:x1875732254966016:12345-0@lo:101: 00010000:00010000:1.0:1788837790.658905:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837790.658920:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a441666600/0x2deb895b363e6237 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e6230 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.658957:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a441666600/0x2deb895b363e6237 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e6230 expref: 14 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.658968:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a441666600/0x2deb895b363e6237 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e6230 expref: 14 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.659111:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a441666600, rc 0) 00000100:00100000:1.0:1788837790.659166:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:7591:x1875732254966016:12345-0@lo:101: Request processed in 280us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837790.659173:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788837790.659297:0:7591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254966016:0@lo:101: 00010000:00010000:2.0:1788837790.659313:0:7591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6230 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6237 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837790.659330:0:7591:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6230 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e6237 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837790.659475:0:7591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254966144:0@lo:501: 00000100:00100000:2.0:1788837790.659506:0:7591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837790.659541:0:7591:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4474ead80 going to sleep for 11 seconds 00000100:00100000:1.0:1788837790.659594:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254966144 00000100:00100000:1.0:1788837790.659599:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254966144 00000100:00100000:1.0:1788837790.659630:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788837790.659638:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:7591:x1875732254966144:12345-0@lo:501: 00000100:00100000:1.0:1788837790.659919:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:7591:x1875732254966144:12345-0@lo:501: Request processed in 282us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837790.660044:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788837790.660167:0:7591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254966144:0@lo:501: 00000100:00100000:2.0:1788837790.660243:0:7591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254966272:0@lo:503: 00000100:00100000:2.0:1788837790.660290:0:7591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837790.660306:0:7591:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4474ead80 going to sleep for 11 seconds 00000100:00100000:2.0:1788837790.660323:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254966272 00000100:00100000:2.0:1788837790.660327:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254966272 00000100:00100000:2.0:1788837790.660351:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788837790.660357:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:7591:x1875732254966272:12345-0@lo:503: 00000100:00100000:2.0:1788837790.660542:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:7591:x1875732254966272:12345-0@lo:503: Request processed in 184us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837790.660549:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788837790.660582:0:7591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254966272:0@lo:503: 00000040:00080000:2.0:1788837790.660915:0:7591:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788837790.661403:0:7591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254966400:0@lo:502: 00000100:00100000:2.0:1788837790.661461:0:7591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837790.661537:0:7591:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a449c746c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837790.661670:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254966400 00000100:00100000:3.0:1788837790.661678:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254966400 00000100:00100000:3.0:1788837790.661753:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788837790.661764:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:7591:x1875732254966400:12345-0@lo:502: 00000100:00100000:3.0:1788837790.662039:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:7591:x1875732254966400:12345-0@lo:502: Request processed in 276us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837790.662047:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788837790.662136:0:7591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254966400:0@lo:502: 00000040:00080000:2.0:1788837790.662497:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788837790.662570:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788837790.662608:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788837790.662657:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788837790.662695:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788837790.662764:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788837790.662817:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788837790.662854:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788837790.662919:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788837790.662959:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788837790.662995:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788837790.663045:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788837790.663081:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788837790.663110:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788837790.663150:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788837790.663179:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788837790.663243:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788837790.663289:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788837790.663318:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788837790.663342:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788837790.663387:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788837790.663425:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788837790.663461:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788837790.663527:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788837790.663567:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788837790.663597:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788837790.663647:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788837790.663684:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1788837790.663719:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788837790.663765:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1788837790.663818:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1788837790.663853:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1788837790.663886:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1788837790.663955:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1788837790.664003:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1788837790.664052:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1788837790.664087:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1788837790.664147:0:7591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254966528:0@lo:502: 00000100:00100000:2.0:1788837790.664275:0:7591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837790.664885:0:7591:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a449c746c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837790.664955:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254966528 00000100:00100000:1.0:1788837790.664966:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254966528 00000100:00100000:1.0:1788837790.665125:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788837790.665136:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:7591:x1875732254966528:12345-0@lo:502: 00000100:00100000:1.0:1788837790.665489:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:7591:x1875732254966528:12345-0@lo:502: Request processed in 353us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837790.665498:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788837790.665671:0:7591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254966528:0@lo:502: 00000040:00080000:2.0:1788837790.665802:0:7591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1788837790.665822:0:7591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788837790.666666:0:7606:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788837790.666688:0:7606:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff97a45920b370) 00000020:00000080:1.0:1788837790.666713:0:7606:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1788837790.666821:0:7606:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a3451f4000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788837790.666825:0:7606:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97a3451f4000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788837790.666828:0:7606:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a3451f4000 3 00010000:00080000:1.0:1788837790.666868:0:7606:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a344921000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.154@tcp at head 00010000:00010000:1.0:1788837790.669656:0:7606:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1788837790.669996:0:7606:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788837790.670054:0:7606:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788837790.670079:0:7606:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2deb895b363e6245 00000100:00080000:1.0:1788837790.670095:0:7606:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788837790.670103:0:7606:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97a344921000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788837790.670151:0:7606:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a459207100 x1875732254966656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788837790.670278:0:7606:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788837790.670503:0:3270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459207100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3270:1875732254966656:0@lo:38: 00000100:00100000:3.0:1788837790.670637:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837790.670880:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732254966912:0@lo:400: 00000100:00100000:0.0:1788837790.670914:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837790.670939:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837790.670945:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254967040:0@lo:400: 00000100:00100000:0.0:1788837790.670973:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837790.671076:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254966656 00000100:00100000:0.0:1788837790.671086:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254966656 00000100:00100000:0.0:1788837790.671119:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254966912 00000100:00100000:0.0:1788837790.671122:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254966912 00000100:00100000:0.0:1788837790.671171:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788837790.671182:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732254966912:12345-0@lo:400: 00000100:00100000:0.0:1788837790.671284:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732254966912:12345-0@lo:400: Request processed in 104us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837790.671293:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788837790.671314:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788837790.671319:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3270:x1875732254966656:12345-0@lo:38: 00010000:00080000:0.0:1788837790.671345:0:5810:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:0.0:1788837790.671384:0:5810:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2deb895b363e624c 00000004:00100000:0.0:1788837790.671402:0:5810:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788837790.671440:0:5810:0:(import.c:65:import_set_state_nolock()) ffff97a458cf9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788837790.671481:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3270:x1875732254966656:12345-0@lo:38: Request processed in 160us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837790.671488:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788837790.671508:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254967040 00000100:00100000:0.0:1788837790.671512:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254967040 00000100:00100000:0.0:1788837790.671542:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788837790.671550:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254967040:12345-0@lo:400: 00000100:00100000:0.0:1788837790.671584:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254967040:12345-0@lo:400: Request processed in 37us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837790.671591:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788837790.671614:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788837790.671619:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788837790.671655:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a458c91880 x1875732254967040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837790.671673:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254967040:0@lo:400: 00010000:00080000:0.0:1788837790.671687:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a458c93800 x1875732254966912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837790.671729:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732254966912:0@lo:400: 00000100:00100000:3.0:1788837790.671833:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3274:1875732254966784:0@lo:400: 00000100:00100000:3.0:1788837790.671870:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788837790.671921:0:3270:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a459207100 x1875732254966656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788837800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837790.671930:0:3270:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788837790.671938:0:3270:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788837790.671948:0:3270:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788837790.671954:0:3270:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788837790.671956:0:3270:0:(import.c:65:import_set_state_nolock()) ffff97a344921000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788837790.671963:0:3270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459207100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3270:1875732254966656:0@lo:38: 00000100:00100000:1.0:1788837790.672134:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254966784 00000100:00100000:1.0:1788837790.672140:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254966784 00000100:00100000:1.0:1788837790.672183:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788837790.672191:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1875732254966784:12345-0@lo:400: 00000100:00100000:1.0:1788837790.672251:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1875732254966784:12345-0@lo:400: Request processed in 62us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837790.672258:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788837790.672291:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a458c91f80 x1875732254966784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837790.672300:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3274:1875732254966784:0@lo:400: 00000040:00080000:1.0:1788837790.672498:0:7606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1788837790.672688:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459204380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7607:1875732254967168:0@lo:901: 00000100:00100000:1.0:1788837790.672725:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837790.672757:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254967168 00000100:00100000:1.0:1788837790.672762:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254967168 00000100:00100000:1.0:1788837790.672818:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788837790.672825:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459207480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7607:x1875732254967168:12345-0@lo:901: 00000100:00100000:1.0:1788837790.673481:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459207480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7607:x1875732254967168:12345-0@lo:901: Request processed in 653us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837790.673498:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788837790.673527:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837790.673540:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4496f86c0 going to sleep for 11 seconds 00010000:00080000:1.0:1788837790.673563:0:7607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a459204380 x1875732254967168/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788837806 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837790.673577:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459204380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7607:1875732254967168:0@lo:901: 00000020:01000000:0.0:1788837790.673853:0:7591:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788837790.673890:0:7591:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788837790.673917:0:7591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6230 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6237 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837790.673938:0:7591:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6230 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6237 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788837790.674150:0:7591:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788837790.674153:0:7591:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788837790.674154:0:7591:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837790.674156:0:7591:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837790.674157:0:7591:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837790.674159:0:7591:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837790.674160:0:7591:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788837790.674162:0:7591:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788837790.674164:0:7591:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788837790.674166:0:7591:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837790.674167:0:7591:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788837790.674173:0:7591:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788837790.674175:0:7591:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788837790.674177:0:7591:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788837790.674178:0:7591:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837790.674179:0:7591:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837790.674180:0:7591:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837790.674182:0:7591:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837790.674183:0:7591:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788837790.674184:0:7591:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788837790.674185:0:7591:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788837790.674186:0:7591:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837790.674187:0:7591:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788837790.674389:0:7591:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788837790.674408:0:7591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254967296:0@lo:253: 00000100:00100000:1.0:1788837790.674467:0:7591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837790.674555:0:7591:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4496f86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837790.677601:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254967296 00000100:00100000:3.0:1788837790.677623:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254967296 00000100:00100000:3.0:1788837790.677708:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788837790.677721:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:7591:x1875732254967296:12345-0@lo:253: 20000000:01000000:3.0:1788837790.677765:0:5802:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788837790.677807:0:5802:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788837790.733871:0:5802:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788837790.733898:0:5802:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788837790.733988:0:5824:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788837790.733995:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788837790.734030:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a441464600/0x2deb895b363e6253 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837790.734054:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a441667000/0x2deb895b363e61a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e619d expref: 14 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837790.734065:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a441464600/0x2deb895b363e6253 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837790.734122:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a441667000/0x2deb895b363e61a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e619d expref: 14 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837790.734141:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a441667000/0x2deb895b363e61a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e619d expref: 14 pid: 5800 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837790.734160:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4bb100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5824:1875732254967424:0@lo:104: 00000100:00100000:2.0:1788837790.734278:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837790.734340:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4474eacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837790.734596:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254967424 00000100:00100000:1.0:1788837790.734607:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254967424 00000100:00100000:1.0:1788837790.734678:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788837790.734691:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+3:5824:x1875732254967424:12345-0@lo:104: 00010000:00010000:1.0:1788837790.734707:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a441521600/0x2deb895b363e619d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e61a4 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.734772:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788837790.734788:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+3:5824:x1875732254967424:12345-0@lo:104: Request processed in 90us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837790.734804:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788837790.734831:0:7597:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837790.734839:0:7597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a441521600/0x2deb895b363e619d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e61a4 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.734846:0:7597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441521600 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:1.0:1788837790.734871:0:7597:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a441521600/0x2deb895b363e619d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e61a4 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.734880:0:7597:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a441521600/0x2deb895b363e619d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e61a4 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837790.734887:0:7597:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a441521600/0x2deb895b363e619d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e61a4 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837790.734893:0:7597:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837790.734936:0:7597:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a441521600/0x2deb895b363e619d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e61a4 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.734943:0:7597:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837790.734963:0:7597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a441521600/0x2deb895b363e619d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e61a4 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.734969:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a441521600/0x2deb895b363e619d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e61a4 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837790.735359:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837790.735361:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837790.735363:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837790.735392:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459204380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732254967552:0@lo:103: 00000100:00100000:1.0:1788837790.735447:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837790.735641:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254967552 00000100:00100000:2.0:1788837790.735658:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254967552 00010000:00010000:2.0:1788837790.735688:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a441667000/0x2deb895b363e61a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e619d expref: 15 pid: 5800 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837790.735727:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788837790.735736:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4497d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:3273:x1875732254967552:12345-0@lo:103: 00010000:00010000:2.0:1788837790.735750:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837790.735754:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a441667000/0x2deb895b363e61a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e619d expref: 15 pid: 5800 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837790.735765:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a441667000/0x2deb895b363e61a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e619d expref: 15 pid: 5800 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837790.735788:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a441464600/0x2deb895b363e6253 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837790.735808:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a441464600/0x2deb895b363e6253 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788837790.735827:0:5794:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002095110s 00010000:00010000:2.0:1788837790.735833:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a441464600/0x2deb895b363e6253 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837790.735840:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a441464600/0x2deb895b363e6253 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837790.735849:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a441464600/0x2deb895b363e6253 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837790.735856:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a441464600/0x2deb895b363e6253 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837790.735872:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441464600 already unused, calling callback (ffffffffc1616420) 00010000:00010000:2.0:1788837790.735877:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a441464600/0x2deb895b363e6253 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837790.735886:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a441464600/0x2deb895b363e6253 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837790.735896:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a441464600/0x2deb895b363e6253 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837790.735908:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837790.735960:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4497d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:3273:x1875732254967552:12345-0@lo:103: Request processed in 226us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837790.735969:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788837790.737083:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459204380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732254967552:0@lo:103: 00010000:00010000:2.0:1788837790.737143:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a441667000/0x2deb895b363e61a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e619d expref: 14 pid: 5800 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837790.737160:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4bb100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5824:1875732254967424:0@lo:104: 00010000:00010000:2.0:1788837790.737180:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a441464600/0x2deb895b363e6253 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837790.737191:0:5824:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97a441464600/0x2deb895b363e6253 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837790.737198:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a441464600/0x2deb895b363e6253 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837790.737237:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a441464600/0x2deb895b363e6253 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837790.747388:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:7591:x1875732254967296:12345-0@lo:253: Request processed in 69654us (72906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837790.747407:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788837790.747518:0:7591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7591:1875732254967296:0@lo:253: 10000000:01000000:2.0:1788837790.747538:0:7591:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788837790.747542:0:7591:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788837790.747544:0:7591:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788837790.747545:0:7591:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788837790.747546:0:7591:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788837790.747548:0:7591:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788837790.747549:0:7591:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788837790.747550:0:7591:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788837790.747552:0:7591:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788837790.747553:0:7591:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788837790.747555:0:7591:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788837790.747556:0:7591:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788837790.747576:0:7591:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788837790.760174:0:7591:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788837790.760667:0:7591:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788837790.761008:0:7591:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788837790.761271:0:7591:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788837790.761459:0:7591:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788837790.761726:0:7591:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788837790.768250:0:7591:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788837791.048303:0:7591:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788837791.048318:0:7591:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788837791.048444:0:7591:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788837791.048516:0:7591:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788837791.048536:0:7591:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788837791.048571:0:7591:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788837791.266582:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837792.300547:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837792.420341:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459204a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254967680:0@lo:13: 00000100:00100000:1.0:1788837792.420432:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837792.420521:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254967680 00000100:00100000:1.0:1788837792.420528:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254967680 00000100:00100000:1.0:1788837792.420584:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788837792.420592:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459204380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254967680:12345-0@lo:13: 00002000:00000024:1.0:1788837792.420630:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837792.420839:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459204380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254967680:12345-0@lo:13: Request processed in 247us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837792.420846:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788837792.420867:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788837792.420899:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a459204a80 x1875732254967680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837792.420916:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459204a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254967680:0@lo:13: 00010000:00010000:3.0:1788837793.316296:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837794.344962:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837795.362421:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837796.003461:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732254968064:0@lo:400: 00000100:00100000:2.0:1788837796.003552:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837796.003609:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837796.003616:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254968192:0@lo:400: 00000100:00100000:2.0:1788837796.003641:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837796.003677:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254968064 00000100:00100000:2.0:1788837796.003685:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254968064 00000100:00100000:2.0:1788837796.003747:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788837796.003755:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1875732254968064:12345-0@lo:400: 00000100:00100000:2.0:1788837796.003802:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1875732254968064:12345-0@lo:400: Request processed in 48us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837796.003814:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1788837796.003834:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788837796.003861:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a46f4ba300 x1875732254968064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837796.003889:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732254968064:0@lo:400: 00000100:00100000:0.0:1788837796.004361:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732254967808:0@lo:400: 00000100:00100000:0.0:1788837796.004418:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837796.004447:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732254968320:0@lo:400: 00000100:00100000:0.0:1788837796.004477:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837796.004506:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837796.004513:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732254967936:0@lo:400: 00000100:00100000:0.0:1788837796.004535:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837796.004580:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254968192 00000100:00100000:0.0:1788837796.004584:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254968192 00000100:00100000:0.0:1788837796.004630:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788837796.004640:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254968192:12345-0@lo:400: 00000100:00100000:0.0:1788837796.004682:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254968192:12345-0@lo:400: Request processed in 46us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837796.004699:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788837796.004719:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254968320 00000100:00100000:0.0:1788837796.004722:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254968320 00000100:00100000:0.0:1788837796.004740:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254967936 00000100:00100000:0.0:1788837796.004742:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254967936 00000100:00100000:0.0:1788837796.004754:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788837796.004760:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1875732254968320:12345-0@lo:400: 00000100:00100000:0.0:1788837796.004809:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1875732254968320:12345-0@lo:400: Request processed in 49us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837796.004816:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788837796.004827:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788837796.004832:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732254967936:12345-0@lo:400: 00000100:00100000:0.0:1788837796.004858:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732254967936:12345-0@lo:400: Request processed in 26us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837796.004864:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788837796.004966:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a46f4b9180 x1875732254967936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837796.004979:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732254967936:0@lo:400: 00010000:00080000:3.0:1788837796.005002:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a46f4b9f80 x1875732254968320/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837796.005010:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732254968320:0@lo:400: 00000100:00100000:0.0:1788837796.005022:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254967808 00000100:00100000:0.0:1788837796.005026:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254967808 00000100:00100000:0.0:1788837796.005059:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788837796.005065:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:3271:x1875732254967808:12345-0@lo:400: 00000100:00100000:0.0:1788837796.005099:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:3271:x1875732254967808:12345-0@lo:400: Request processed in 34us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837796.005105:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788837796.005234:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732254967808:0@lo:400: 00000100:00080000:0.0:1788837796.005388:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788837796.005394:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788837796.005423:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a46f4b8000 x1875732254968192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837796.005433:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254968192:0@lo:400: 00010000:00010000:2.0:1788837796.395872:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837797.416561:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837797.540555:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459204a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254968448:0@lo:13: 00000100:00100000:2.0:1788837797.540635:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837797.540747:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254968448 00000100:00100000:2.0:1788837797.540756:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254968448 00000100:00100000:2.0:1788837797.540806:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788837797.540814:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732254968448:12345-0@lo:13: 00002000:00000024:2.0:1788837797.540853:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837797.540901:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732254968448:12345-0@lo:13: Request processed in 87us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837797.540908:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788837797.540954:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a459204a80 x1875732254968448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837797.540972:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459204a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254968448:0@lo:13: 00000001:02000400:0.0:1788837798.410863:0:7950:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788837798.434414:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788837798.566791:0:5805:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788837798.566802:0:5805:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97a448f86800 from 30 10000000:01000000:2.0:1788837798.566807:0:5805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788837798.566861:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441464c00/0x2deb895b363e625a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837798.566874:0:5805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a441464c00/0x2deb895b363e625a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837798.566904:0:5805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a441464c00/0x2deb895b363e625a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837798.566931:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254968576:0@lo:101: 00000100:00100000:2.0:1788837798.567222:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837798.567277:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a460d22cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837798.567328:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254968576 00000100:00100000:0.0:1788837798.567336:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254968576 00000100:00100000:0.0:1788837798.567393:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788837798.567404:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:5805:x1875732254968576:12345-0@lo:101: 00010000:00010000:0.0:1788837798.567649:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837798.567665:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a440030600/0x2deb895b363e6261 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e625a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837798.567690:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a440030600/0x2deb895b363e6261 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e625a expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837798.567701:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a440030600/0x2deb895b363e6261 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e625a expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837798.567722:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a440030600, rc 0) 00000100:00100000:0.0:1788837798.567770:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:5805:x1875732254968576:12345-0@lo:101: Request processed in 367us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837798.567776:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788837798.567792:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254968576:0@lo:101: 00010000:00010000:2.0:1788837798.567806:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a441464c00/0x2deb895b363e625a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6261 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837798.567816:0:5805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a441464c00/0x2deb895b363e625a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e6261 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837798.567873:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254968704:0@lo:501: 00000100:00100000:2.0:1788837798.567901:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837798.567928:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a460d22cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837798.568068:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254968704 00000100:00100000:3.0:1788837798.568073:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254968704 00000100:00100000:3.0:1788837798.568105:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788837798.568111:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:5805:x1875732254968704:12345-0@lo:501: 00000100:00100000:3.0:1788837798.568618:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:5805:x1875732254968704:12345-0@lo:501: Request processed in 505us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837798.568626:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788837798.568726:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254968704:0@lo:501: 00000100:00100000:0.0:1788837798.568756:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254968832:0@lo:503: 00000100:00100000:0.0:1788837798.568791:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837798.568810:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f970c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837798.568926:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254968832 00000100:00100000:2.0:1788837798.568930:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254968832 00000100:00100000:2.0:1788837798.568966:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788837798.569054:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:5805:x1875732254968832:12345-0@lo:503: 00000100:00100000:2.0:1788837798.569680:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:5805:x1875732254968832:12345-0@lo:503: Request processed in 627us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837798.569688:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788837798.569778:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254968832:0@lo:503: 00000100:00100000:0.0:1788837798.570620:0:7958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7958:1875732254968960:0@lo:502: 00000100:00100000:0.0:1788837798.570678:0:7958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837798.570747:0:7958:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f970c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837798.571937:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254968960 00000100:00100000:3.0:1788837798.571950:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254968960 00000100:00100000:3.0:1788837798.572923:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788837798.572935:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a523050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:7958:x1875732254968960:12345-0@lo:502: 00000100:00100000:3.0:1788837798.574075:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a523050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:7958:x1875732254968960:12345-0@lo:502: Request processed in 1135us (3389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837798.574087:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788837798.574289:0:7958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7958:1875732254968960:0@lo:502: 00000100:00100000:2.0:1788837798.574364:0:7958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4bb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7958:1875732254969088:0@lo:502: 00000100:00100000:2.0:1788837798.574429:0:7958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837798.581092:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254969088 00000100:00100000:0.0:1788837798.581110:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254969088 00000100:00100000:0.0:1788837798.581162:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788837798.581172:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:7958:x1875732254969088:12345-0@lo:502: 00000100:00100000:0.0:1788837798.584535:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:7958:x1875732254969088:12345-0@lo:502: Request processed in 3354us (10095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837798.584550:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788837798.586135:0:7958:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a449c740c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837798.586176:0:7958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4bb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7958:1875732254969088:0@lo:502: 00000040:00080000:2.0:1788837798.586230:0:7958:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788837798.592527:0:5805:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788837798.592565:0:5805:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788837798.592576:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441464c00/0x2deb895b363e625a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6261 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837798.592588:0:5805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a441464c00/0x2deb895b363e625a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6261 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837798.592615:0:5805:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788837798.592618:0:5805:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788837798.592621:0:5805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788837798.592674:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a440031600/0x2deb895b363e6268 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837798.592681:0:5805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a440031600/0x2deb895b363e6268 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837798.592690:0:5805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a440031600/0x2deb895b363e6268 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837798.592714:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254969216:0@lo:101: 00000100:00100000:0.0:1788837798.592787:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837798.594097:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254969216 00000100:00100000:3.0:1788837798.594108:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254969216 00000100:00100000:3.0:1788837798.594686:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788837798.594697:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a520450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:5805:x1875732254969216:12345-0@lo:101: 00010000:00010000:3.0:1788837798.594715:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837798.594738:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a44a48be00/0x2deb895b363e626f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e6268 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837798.594779:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a44a48be00/0x2deb895b363e626f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e6268 expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837798.594790:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a44a48be00/0x2deb895b363e626f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e6268 expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837798.594800:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48be00, rc 0) 00000100:00100000:3.0:1788837798.594872:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a520450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:5805:x1875732254969216:12345-0@lo:101: Request processed in 177us (2085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837798.594879:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788837798.595027:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f97540 going to sleep for 11 seconds 00000100:00100000:0.0:1788837798.595053:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254969216:0@lo:101: 00010000:00010000:0.0:1788837798.595070:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a440031600/0x2deb895b363e6268 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e626f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837798.595080:0:5805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a440031600/0x2deb895b363e6268 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e626f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837798.595223:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254969344:0@lo:501: 00000100:00100000:2.0:1788837798.595293:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837798.595323:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f97540 going to sleep for 11 seconds 00000100:00100000:0.0:1788837798.595628:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254969344 00000100:00100000:0.0:1788837798.595635:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254969344 00000100:00100000:0.0:1788837798.595690:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788837798.595697:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a520c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:5805:x1875732254969344:12345-0@lo:501: 00000100:00100000:0.0:1788837798.596007:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a520c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:5805:x1875732254969344:12345-0@lo:501: Request processed in 310us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837798.596014:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788837798.596070:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254969344:0@lo:501: 00000100:00100000:1.0:1788837798.596179:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459205500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254969472:0@lo:503: 00000100:00100000:1.0:1788837798.608907:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837798.608963:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a449f1f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788837798.609070:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254969472 00000100:00100000:3.0:1788837798.609080:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254969472 00000100:00100000:3.0:1788837798.609138:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788837798.609148:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a521850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:5805:x1875732254969472:12345-0@lo:503: 00000100:00100000:3.0:1788837798.609785:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a521850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:5805:x1875732254969472:12345-0@lo:503: Request processed in 636us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837798.609794:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788837798.610135:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459205500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254969472:0@lo:503: 00000100:00100000:0.0:1788837798.610605:0:7963:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c90a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7963:1875732254969600:0@lo:502: 00000100:00100000:0.0:1788837798.610664:0:7963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837798.610698:0:7963:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f97f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788837798.610747:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254969600 00000100:00100000:3.0:1788837798.610753:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254969600 00000100:00100000:3.0:1788837798.610790:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788837798.610797:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a522c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:7963:x1875732254969600:12345-0@lo:502: 00000100:00100000:3.0:1788837798.611147:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a522c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:7963:x1875732254969600:12345-0@lo:502: Request processed in 349us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837798.611155:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788837798.611244:0:7963:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c90a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7963:1875732254969600:0@lo:502: 00000020:01000000:0.0:1788837798.611268:0:7963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837798.611277:0:7963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837798.611279:0:7963:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788837798.611283:0:7963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788837798.611285:0:7963:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788837798.611302:0:7963:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c90a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7963:1875732254969728:0@lo:502: 00000100:00100000:0.0:1788837798.611334:0:7963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837798.611358:0:7963:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f97f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788837798.611493:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254969728 00000100:00100000:3.0:1788837798.611497:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254969728 00000100:00100000:3.0:1788837798.611520:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788837798.611534:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:7963:x1875732254969728:12345-0@lo:502: 00000100:00100000:3.0:1788837798.611662:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:7963:x1875732254969728:12345-0@lo:502: Request processed in 128us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837798.611669:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788837798.612087:0:7963:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c90a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7963:1875732254969728:0@lo:502: 00000020:01000000:0.0:1788837798.612108:0:7963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837798.612113:0:7963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837798.612115:0:7963:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788837798.612118:0:7963:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1788837798.612295:0:5805:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788837798.612314:0:5805:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788837798.612325:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a440031600/0x2deb895b363e6268 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e626f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837798.612336:0:5805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a440031600/0x2deb895b363e6268 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e626f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837798.612348:0:5805:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788837798.612351:0:5805:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97a448c63800 from 30 10000000:01000000:3.0:1788837798.612355:0:5805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788837798.612382:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48a200/0x2deb895b363e6276 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837798.612390:0:5805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a44a48a200/0x2deb895b363e6276 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837798.612400:0:5805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a44a48a200/0x2deb895b363e6276 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837798.612414:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ead3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254969856:0@lo:101: 00000100:00100000:3.0:1788837798.612521:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837798.613662:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a44a314000 going to sleep for 11 seconds 00000100:00100000:0.0:1788837798.621371:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254969856 00000100:00100000:0.0:1788837798.621385:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254969856 00000100:00100000:2.0:1788837798.621750:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788837798.621760:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:5805:x1875732254969856:12345-0@lo:101: 00010000:00010000:2.0:1788837798.621776:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837798.621796:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a441464000/0x2deb895b363e627d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e6276 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837798.621834:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a441464000/0x2deb895b363e627d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e6276 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837798.621846:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a441464000/0x2deb895b363e627d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e6276 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837798.621855:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a441464000, rc 0) 00000100:00100000:2.0:1788837798.621938:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:5805:x1875732254969856:12345-0@lo:101: Request processed in 179us (9415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837798.621944:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788837798.622015:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ead3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254969856:0@lo:101: 00010000:00010000:2.0:1788837798.622033:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a44a48a200/0x2deb895b363e6276 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e627d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837798.622044:0:5805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a44a48a200/0x2deb895b363e6276 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e627d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837798.622133:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254969984:0@lo:501: 00000100:00100000:2.0:1788837798.622166:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837798.622191:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a449c74240 going to sleep for 11 seconds 00000100:00100000:0.0:1788837798.626112:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254969984 00000100:00100000:0.0:1788837798.626131:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254969984 00000100:00100000:0.0:1788837798.626220:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788837798.626232:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:5805:x1875732254969984:12345-0@lo:501: 00000100:00100000:0.0:1788837798.628905:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:5805:x1875732254969984:12345-0@lo:501: Request processed in 2663us (6726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837798.628918:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788837798.628985:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254969984:0@lo:501: 00000100:00100000:0.0:1788837798.629050:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254970112:0@lo:503: 00000100:00100000:0.0:1788837798.629097:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837798.631688:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254970112 00000100:00100000:1.0:1788837798.631704:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254970112 00000100:00100000:1.0:1788837798.631760:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788837798.631770:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:5805:x1875732254970112:12345-0@lo:503: 00000100:00100000:1.0:1788837798.632017:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:5805:x1875732254970112:12345-0@lo:503: Request processed in 247us (2919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837798.632033:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788837798.637242:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f97e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788837798.637313:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254970112:0@lo:503: 00000100:00100000:1.0:1788837798.637880:0:7965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459207100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7965:1875732254970240:0@lo:502: 00000100:00100000:2.0:1788837798.638511:0:7965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837798.638556:0:7965:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a449f1f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788837798.638909:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254970240 00000100:00100000:1.0:1788837798.638917:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254970240 00000100:00100000:1.0:1788837798.638973:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788837798.638982:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a521c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:7965:x1875732254970240:12345-0@lo:502: 00000100:00100000:1.0:1788837798.639296:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a521c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:7965:x1875732254970240:12345-0@lo:502: Request processed in 314us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837798.639303:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788837798.639629:0:7965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459207100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7965:1875732254970240:0@lo:502: 00000100:00100000:3.0:1788837798.639701:0:7965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ead3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7965:1875732254970368:0@lo:502: 00000100:00100000:3.0:1788837798.639746:0:7965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837798.639783:0:7965:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a44a314a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788837798.639847:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254970368 00000100:00100000:1.0:1788837798.639851:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254970368 00000100:00100000:1.0:1788837798.639889:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788837798.639897:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a520850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:7965:x1875732254970368:12345-0@lo:502: 00000100:00100000:1.0:1788837798.640056:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a520850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:7965:x1875732254970368:12345-0@lo:502: Request processed in 160us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837798.640063:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788837798.640100:0:7965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ead3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7965:1875732254970368:0@lo:502: 00000040:00080000:2.0:1788837798.640133:0:7965:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788837798.640311:0:5805:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788837798.640334:0:5805:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788837798.640343:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48a200/0x2deb895b363e6276 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e627d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837798.640354:0:5805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a44a48a200/0x2deb895b363e6276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e627d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837798.640363:0:5805:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788837798.640366:0:5805:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97a448c63800 from 5 10000000:01000000:3.0:1788837798.640368:0:5805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788837798.640394:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48a800/0x2deb895b363e6284 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837798.640403:0:5805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a44a48a800/0x2deb895b363e6284 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837798.640413:0:5805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a44a48a800/0x2deb895b363e6284 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837798.640545:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ead2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254970496:0@lo:101: 00000100:00100000:3.0:1788837798.640574:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837798.640606:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a44a314b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788837798.640673:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254970496 00000100:00100000:1.0:1788837798.640678:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254970496 00000100:00100000:1.0:1788837798.640712:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788837798.640718:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a522850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:5805:x1875732254970496:12345-0@lo:101: 00010000:00010000:1.0:1788837798.640726:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837798.640740:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a441667c00/0x2deb895b363e628b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e6284 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837798.640761:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a441667c00/0x2deb895b363e628b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e6284 expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837798.640784:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a441667c00/0x2deb895b363e628b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e6284 expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837798.640792:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a441667c00, rc 0) 00000100:00100000:1.0:1788837798.640821:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a522850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:5805:x1875732254970496:12345-0@lo:101: Request processed in 103us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837798.640827:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788837798.640982:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ead2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254970496:0@lo:101: 00010000:00010000:3.0:1788837798.640997:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a44a48a800/0x2deb895b363e6284 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e628b expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837798.641005:0:5805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a44a48a800/0x2deb895b363e6284 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e628b expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837798.641052:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ead2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254970624:0@lo:256: 00000100:00100000:3.0:1788837798.641081:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837798.641101:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a44a314b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837798.641123:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254970624 00000100:00100000:3.0:1788837798.641127:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254970624 00000100:00100000:3.0:1788837798.641147:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788837798.641153:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:5805:x1875732254970624:12345-0@lo:256: 20000000:01000000:3.0:1788837798.641165:0:5802:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788837798.641182:0:5802:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788837798.641184:0:5802:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788837798.641273:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:5805:x1875732254970624:12345-0@lo:256: Request processed in 119us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837798.641280:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788837798.641527:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ead2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254970624:0@lo:256: 10000000:01000000:3.0:1788837798.641572:0:5805:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788837798.641579:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48a800/0x2deb895b363e6284 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e628b expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837798.641587:0:5805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a44a48a800/0x2deb895b363e6284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e628b expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837798.641595:0:5805:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788837798.641597:0:5805:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1788837798.641600:0:5805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788837798.641619:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48ba00/0x2deb895b363e6292 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837798.641636:0:5805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a44a48ba00/0x2deb895b363e6292 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837798.641655:0:5805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a44a48ba00/0x2deb895b363e6292 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837798.641667:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ead2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254970752:0@lo:101: 00000100:00100000:3.0:1788837798.641694:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837798.641723:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a44a314b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788837798.641891:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254970752 00000100:00100000:1.0:1788837798.641896:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254970752 00000100:00100000:1.0:1788837798.641933:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788837798.641940:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a523c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:5805:x1875732254970752:12345-0@lo:101: 00010000:00010000:1.0:1788837798.641948:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837798.641957:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a441667000/0x2deb895b363e6299 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e6292 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837798.641974:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a441667000/0x2deb895b363e6299 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e6292 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837798.641983:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a441667000/0x2deb895b363e6299 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e6292 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837798.641990:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a441667000, rc 0) 00000100:00100000:1.0:1788837798.642021:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a523c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:5805:x1875732254970752:12345-0@lo:101: Request processed in 80us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837798.642027:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788837798.642312:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ead2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254970752:0@lo:101: 00010000:00010000:3.0:1788837798.642325:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a44a48ba00/0x2deb895b363e6292 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6299 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837798.642334:0:5805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a44a48ba00/0x2deb895b363e6292 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e6299 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837798.642385:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ead2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254970880:0@lo:501: 00000100:00100000:3.0:1788837798.642412:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837798.642438:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a44a314b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788837798.644614:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254970880 00000100:00100000:1.0:1788837798.644626:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254970880 00000100:00100000:1.0:1788837798.644696:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788837798.644715:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:5805:x1875732254970880:12345-0@lo:501: 00000100:00100000:1.0:1788837798.645841:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:5805:x1875732254970880:12345-0@lo:501: Request processed in 1113us (3412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837798.645854:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788837798.646592:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ead2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254970880:0@lo:501: 00000100:00100000:3.0:1788837798.646664:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ead2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254971008:0@lo:503: 00000100:00100000:3.0:1788837798.646725:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837798.646812:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a44a314b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788837798.646908:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254971008 00000100:00100000:1.0:1788837798.646914:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254971008 00000100:00100000:1.0:1788837798.647129:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788837798.647139:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:5805:x1875732254971008:12345-0@lo:503: 00000100:00100000:1.0:1788837798.647554:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:5805:x1875732254971008:12345-0@lo:503: Request processed in 415us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837798.647562:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788837798.648250:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ead2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254971008:0@lo:503: 00000100:00100000:2.0:1788837798.648481:0:7967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7967:1875732254971136:0@lo:502: 00000100:00100000:2.0:1788837798.648526:0:7967:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837798.649335:0:7967:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a449c74a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837798.649477:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254971136 00000100:00100000:3.0:1788837798.649484:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254971136 00000100:00100000:3.0:1788837798.649524:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788837798.649542:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:7967:x1875732254971136:12345-0@lo:502: 00000100:00100000:3.0:1788837798.650138:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:7967:x1875732254971136:12345-0@lo:502: Request processed in 598us (1610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837798.650146:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788837798.651109:0:7967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7967:1875732254971136:0@lo:502: 00000020:01000000:3.0:1788837798.651409:0:7967:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788837798.651479:0:7967:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788837798.651490:0:7967:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837798.651492:0:7967:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788837798.651497:0:7967:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788837798.651501:0:7967:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:01000000:3.0:1788837798.651527:0:7967:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788837798.651530:0:7967:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788837798.651546:0:7967:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff97a46e6a0000) 00000020:00000080:3.0:1788837798.651568:0:7967:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788837798.651575:0:7967:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788837798.651665:0:7967:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788837798.651671:0:7967:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788837798.651678:0:7967:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2deb895b363e62a7 00010000:00080000:3.0:1788837798.651708:0:7967:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a3451f0800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:3.0:1788837798.654491:0:7967:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1788837798.655677:0:7967:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788837798.655695:0:7967:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788837798.657921:0:7967:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788837798.658254:0:7967:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788837798.658927:0:7967:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788837798.659551:0:7967:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788837798.669087:0:7968:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788837798.669097:0:7968:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788837798.702265:0:7967:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788837798.702282:0:7967:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788837798.703913:0:7967:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788837798.703947:0:7967:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2deb895b363e62ae 00000100:00080000:1.0:1788837798.703960:0:7967:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788837798.703966:0:7967:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97a3451f0800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788837798.704005:0:7967:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a459204000 x1875732254971264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788837798.704043:0:7967:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788837798.704123:0:7967:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788837798.704128:0:7967:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837798.704131:0:7967:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788837798.704134:0:7967:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788837798.704138:0:7967:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837798.704139:0:7967:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788837798.704149:0:7967:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788837798.704151:0:7967:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788837798.704178:0:7967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459206300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7967:1875732254971392:0@lo:502: 00000100:00100000:1.0:1788837798.704283:0:7967:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837798.704955:0:3270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459204000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3270:1875732254971264:0@lo:8: 00000100:00100000:2.0:1788837798.705000:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837798.705199:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732254971520:0@lo:400: 00000100:00100000:2.0:1788837798.705246:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837798.705318:0:7967:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a449e7d240 going to sleep for 11 seconds 00000100:00100000:1.0:1788837798.705340:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254971392 00000100:00100000:1.0:1788837798.705347:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254971392 00000100:00100000:1.0:1788837798.705397:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788837798.705407:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:7967:x1875732254971392:12345-0@lo:502: 00000100:00100000:1.0:1788837798.707750:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:7967:x1875732254971392:12345-0@lo:502: Request processed in 2336us (3459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837798.707762:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788837798.707849:0:7967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459206300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:7967:1875732254971392:0@lo:502: 00000020:01000000:1.0:1788837798.707879:0:7967:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788837798.707886:0:7967:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837798.707888:0:7967:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788837798.707893:0:7967:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:1.0:1788837798.708469:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254971520 00000100:00100000:1.0:1788837798.708477:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254971520 00000100:00100000:1.0:1788837798.708518:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788837798.708527:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732254971520:12345-0@lo:400: 00000100:00100000:0.0:1788837798.712012:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3274:1875732254971648:0@lo:400: 00000100:00100000:0.0:1788837798.712084:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837798.712138:0:5809:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788837798.712145:0:5809:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788837798.712160:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254971776:0@lo:400: 00000100:00100000:0.0:1788837798.712187:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837798.712547:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837798.712555:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732254971904:0@lo:400: 00000100:00100000:0.0:1788837798.712588:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837798.712613:0:5808:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788837798.712620:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254971648 00000100:00100000:0.0:1788837798.712627:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254971648 00000100:00100000:0.0:1788837798.712682:0:5808:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788837798.712687:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254971904 00000100:00100000:0.0:1788837798.712690:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254971904 00000100:00100000:0.0:1788837798.712703:0:5808:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788837798.712723:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788837798.712732:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1875732254971648:12345-0@lo:400: 00000100:00100000:0.0:1788837798.712787:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1875732254971648:12345-0@lo:400: Request processed in 56us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837798.712805:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788837798.712894:0:5808:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788837798.712903:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788837798.712909:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1875732254971904:12345-0@lo:400: 00000100:00100000:0.0:1788837798.712943:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1875732254971904:12345-0@lo:400: Request processed in 34us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837798.712949:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788837798.713086:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254971264 00000100:00100000:0.0:1788837798.713090:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254971264 00000100:00100000:0.0:1788837798.713108:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254971776 00000100:00100000:0.0:1788837798.713110:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254971776 00000100:00100000:0.0:1788837798.713134:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788837798.713141:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254971776:12345-0@lo:400: 00000100:00100000:0.0:1788837798.713172:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254971776:12345-0@lo:400: Request processed in 32us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837798.713178:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788837798.713190:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788837798.713193:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3270:x1875732254971264:12345-0@lo:8: 00010000:00080000:0.0:1788837798.713239:0:6653:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:0.0:1788837798.713264:0:6653:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2deb895b363e62b5 00002000:00100000:0.0:1788837798.713279:0:6653:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff97a458cfb800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113975 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788837798.713283:0:6653:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1788837798.713286:0:6653:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1788837798.713605:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732254971520:12345-0@lo:400: Request processed in 5078us (8356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837798.713613:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00002000:00100000:0.0:1788837798.715042:0:6653:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788837798.715198:0:6653:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788837798.715245:0:6653:0:(import.c:65:import_set_state_nolock()) ffff97a458cfe000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788837798.716541:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3270:x1875732254971264:12345-0@lo:8: Request processed in 3338us (11532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837798.716553:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788837798.716606:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788837798.716612:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788837798.716662:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a458c93480 x1875732254971648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837798.716677:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3274:1875732254971648:0@lo:400: 00010000:00080000:0.0:1788837798.716715:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a458c92d80 x1875732254971904/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837798.716724:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732254971904:0@lo:400: 00010000:00080000:0.0:1788837798.716736:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a458c91500 x1875732254971776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837798.716744:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254971776:0@lo:400: 00010000:00080000:0.0:1788837798.716792:0:3270:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a459204000 x1875732254971264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788837808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837798.716800:0:3270:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788837798.716807:0:3270:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788837798.716816:0:3270:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788837798.718405:0:3270:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788837798.718486:0:3270:0:(import.c:65:import_set_state_nolock()) ffff97a3451f0800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788837798.718507:0:3270:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788837798.718517:0:3270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459204000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3270:1875732254971264:0@lo:8: 00000004:00080000:0.0:1788837798.718563:0:7968:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788837798.718719:0:7968:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 178812514882ns, next at 0ns, rc = 0 00010000:00080000:2.0:1788837798.719135:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a458c90a80 x1875732254971520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837798.719149:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732254971520:0@lo:400: 00000020:01000000:2.0:1788837798.719171:0:5805:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788837798.719196:0:5805:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788837798.719228:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48ba00/0x2deb895b363e6292 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6299 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837798.719251:0:5805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a44a48ba00/0x2deb895b363e6292 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6299 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837798.719261:0:5805:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788837798.719264:0:5805:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97a448f399b8 from 1 10000000:01000000:2.0:1788837798.719267:0:5805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788837798.719906:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441465800/0x2deb895b363e62bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837798.719918:0:5805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a441465800/0x2deb895b363e62bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837798.719929:0:5805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a441465800/0x2deb895b363e62bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837798.719948:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254972032:0@lo:101: 00000100:00100000:2.0:1788837798.720010:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837798.720051:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a449c74240 going to sleep for 11 seconds 00000100:00100000:2.0:1788837798.724041:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254972032 00000100:00100000:2.0:1788837798.724056:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254972032 00000100:00100000:2.0:1788837798.724120:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788837798.724131:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:5805:x1875732254972032:12345-0@lo:101: 00010000:00010000:2.0:1788837798.724148:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837798.724167:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a441464400/0x2deb895b363e62c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e62bc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837798.724197:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a441464400/0x2deb895b363e62c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e62bc expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837798.724237:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a441464400/0x2deb895b363e62c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e62bc expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837798.724246:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a441464400, rc 0) 00000100:00100000:2.0:1788837798.724341:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:5805:x1875732254972032:12345-0@lo:101: Request processed in 212us (4330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837798.724347:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788837798.724404:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254972032:0@lo:101: 00010000:00010000:2.0:1788837798.725402:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a441465800/0x2deb895b363e62bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e62c3 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837798.725426:0:5805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a441465800/0x2deb895b363e62bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e62c3 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837798.725507:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254972160:0@lo:501: 00000100:00100000:2.0:1788837798.725555:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837798.725588:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a449c74240 going to sleep for 11 seconds 00000100:00100000:1.0:1788837798.725928:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254972160 00000100:00100000:1.0:1788837798.725935:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254972160 00000100:00100000:1.0:1788837798.725977:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788837798.725984:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:5805:x1875732254972160:12345-0@lo:501: 00000100:00100000:1.0:1788837798.728527:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:5805:x1875732254972160:12345-0@lo:501: Request processed in 2535us (2964us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788837798.728542:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788837798.728604:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254972160:0@lo:501: 10000000:01000000:1.0:1788837798.728653:0:5805:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788837798.728663:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441465800/0x2deb895b363e62bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e62c3 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837798.728674:0:5805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a441465800/0x2deb895b363e62bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e62c3 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788837798.811158:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788837798.856075:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254972288:0@lo:13: 00000100:00100000:0.0:1788837798.856161:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837798.856219:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254972288 00000100:00100000:1.0:1788837798.856227:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254972288 00000004:00080000:2.0:1788837798.856277:0:7971:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788837798.856283:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788837798.856291:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3273:x1875732254972288:12345-0@lo:13: 00000100:00100000:2.0:1788837798.856300:0:7971:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4baa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7971:1875732254972416:0@lo:7: 00000100:00100000:2.0:1788837798.856327:0:7971:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1788837798.856333:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788837798.856349:0:7971:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a341083f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788837798.856438:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254972416 00000100:00100000:2.0:1788837798.856444:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254972416 00000100:00100000:2.0:1788837798.856475:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788837798.856481:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:7971:x1875732254972416:12345-0@lo:7: 00000100:00100000:1.0:1788837798.858666:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3273:x1875732254972288:12345-0@lo:13: Request processed in 2369us (2498us total) trans 0 rc 0/0 00010000:00080000:0.0:1788837798.858666:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a46f4b8a80 x1875732254972288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837814 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837798.858677:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788837798.858689:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254972288:0@lo:13: 00000100:00080000:0.0:1788837798.858712:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1788837798.867031:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788837798.867045:0:6682:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788837798.867188:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:7971:x1875732254972416:12345-0@lo:7: Request processed in 10701us (10854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837798.867198:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788837798.867568:0:7971:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a46f4baa00 x1875732254972416/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788837814 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837798.867584:0:7971:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4baa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7971:1875732254972416:0@lo:7: 00000004:00080000:3.0:1788837798.867614:0:7971:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788837798.867666:0:7971:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ead1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7971:1875732254972544:0@lo:5: 00000100:00100000:3.0:1788837798.867706:0:7971:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837798.867732:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254972544 00000100:00100000:2.0:1788837798.867738:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254972544 00000100:00100000:3.0:1788837798.867739:0:7971:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a44a3146c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837798.867774:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788837798.867782:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7971:x1875732254972544:12345-0@lo:5: 00002000:00080000:2.0:1788837798.867806:0:6652:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788837798.867810:0:6652:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788837798.868259:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7971:x1875732254972544:12345-0@lo:5: Request processed in 477us (552us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788837798.868267:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788837798.870921:0:7971:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a46ead1180 x1875732254972544/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788837814 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837798.870942:0:7971:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ead1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7971:1875732254972544:0@lo:5: 00000004:00080000:0.0:1788837798.870957:0:7971:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788837798.871000:0:7971:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c92d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7971:1875732254972672:0@lo:700: 00000100:00100000:0.0:1788837798.871056:0:7971:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837798.871092:0:7971:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f97b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788837798.871887:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254972672 00000100:00100000:1.0:1788837798.871895:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254972672 00000100:00100000:1.0:1788837798.871951:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788837798.871961:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7971:x1875732254972672:12345-0@lo:700: 00000100:00100000:1.0:1788837798.872003:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459206300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6659:1875732254972800:0@lo:700: 00000100:00100000:1.0:1788837798.872039:0:6659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837798.872068:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a449e7d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788837798.872085:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254972800 00000100:00100000:0.0:1788837798.872090:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254972800 00000100:00100000:0.0:1788837798.872154:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788837798.872161:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459205880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6659:x1875732254972800:12345-0@lo:700: 40000000:02000000:2.0:1788837798.923003:0:5815:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1788837798.933351:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459205880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6659:x1875732254972800:12345-0@lo:700: Request processed in 61181us (61301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837798.933364:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788837798.933517:0:6659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a459206300 x1875732254972800/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788837814 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837798.933539:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459206300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6659:1875732254972800:0@lo:700: 40000000:02000000:1.0:1788837798.933554:0:6659:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:2.0:1788837799.016911:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7971:x1875732254972672:12345-0@lo:700: Request processed in 144941us (145844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837799.016930:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00100000:2.0:1788837799.016978:0:7611:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788837799.016995:0:7611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00010000:00080000:2.0:1788837799.017038:0:7971:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a458c92d80 x1875732254972672/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788837814 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837799.017054:0:7971:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c92d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7971:1875732254972672:0@lo:700: 00000004:02000040:2.0:1788837799.054567:0:7971:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1788837799.061388:0:7971:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7971:1875732254972928:0@lo:5: 00000100:00100000:2.0:1788837799.061481:0:7971:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837799.061535:0:7971:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a341083a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837799.061859:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254972928 00000100:00100000:0.0:1788837799.061870:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254972928 00000100:00100000:0.0:1788837799.061936:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788837799.061946:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7971:x1875732254972928:12345-0@lo:5: 00002000:00080000:1.0:1788837799.075716:0:6653:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788837799.075741:0:6653:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1788837799.079732:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7971:x1875732254972928:12345-0@lo:5: Request processed in 17776us (18239us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788837799.079748:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788837799.080950:0:7971:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a46f4b9c00 x1875732254972928/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788837815 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837799.080968:0:7971:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788837799.080988:0:7971:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff97a46f4b9c00 x1875732254972928/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788837815 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837799.081001:0:7971:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7971:1875732254972928:0@lo:5: 00000004:00080000:3.0:1788837799.081016:0:7971:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1788837799.458396:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837800.487401:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837801.517951:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837802.530699:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837802.659434:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254973056:0@lo:13: 00000100:00100000:0.0:1788837802.659531:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837802.659672:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254973056 00000100:00100000:0.0:1788837802.659683:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254973056 00000100:00100000:0.0:1788837802.659750:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788837802.659760:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254973056:12345-0@lo:13: 00002000:00000024:0.0:1788837802.659881:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837802.659998:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254973056:12345-0@lo:13: Request processed in 238us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837802.660006:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788837802.660035:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788837802.660072:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a458c92300 x1875732254973056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837802.660094:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254973056:0@lo:13: 00010000:00010000:2.0:1788837803.554462:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788837804.007472:0:7611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1788837804.199088:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254973184:0@lo:13: 00000100:00100000:0.0:1788837804.199190:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837804.199322:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254973184 00000100:00100000:0.0:1788837804.199334:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254973184 00000100:00100000:0.0:1788837804.199408:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788837804.199419:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254973184:12345-0@lo:13: 00002000:00000024:0.0:1788837804.199465:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837804.199523:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254973184:12345-0@lo:13: Request processed in 105us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837804.199530:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788837804.199569:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788837804.199604:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a458c92300 x1875732254973184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837820 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837804.199616:0:3271:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788837804.199641:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254973184:0@lo:13: 00000100:00100000:1.0:1788837804.200128:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459207800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732254973440:0@lo:400: 00000100:00100000:1.0:1788837804.200178:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837804.200225:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837804.200232:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459204e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732254973568:0@lo:400: 00000100:00100000:1.0:1788837804.200258:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837804.200297:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254973440 00000100:00100000:1.0:1788837804.200304:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254973440 00000100:00100000:1.0:1788837804.200347:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254973568 00000100:00100000:1.0:1788837804.200350:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254973568 00000100:00100000:1.0:1788837804.200384:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788837804.200393:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459204000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732254973440:12345-0@lo:400: 00000100:00100000:1.0:1788837804.200441:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459204000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732254973440:12345-0@lo:400: Request processed in 50us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837804.200449:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788837804.200466:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788837804.200473:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459207100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1875732254973568:12345-0@lo:400: 00000100:00100000:1.0:1788837804.200500:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459207100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1875732254973568:12345-0@lo:400: Request processed in 29us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837804.200518:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788837804.200556:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459206300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732254973312:0@lo:400: 00000100:00100000:1.0:1788837804.200596:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837804.200627:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459204700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3272:1875732254973824:0@lo:400: 00000100:00100000:1.0:1788837804.200651:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837804.200669:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837804.200675:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459207b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254973696:0@lo:400: 00000100:00100000:1.0:1788837804.200702:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837804.200733:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254973696 00000100:00100000:1.0:1788837804.200737:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254973696 00000100:00100000:1.0:1788837804.200769:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788837804.200776:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459204a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732254973696:12345-0@lo:400: 00000100:00100000:1.0:1788837804.200813:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459204a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732254973696:12345-0@lo:400: Request processed in 37us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837804.200820:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788837804.200837:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788837804.200842:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788837804.200870:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a459204e00 x1875732254973568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837804.200886:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459204e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732254973568:0@lo:400: 00010000:00080000:1.0:1788837804.200897:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a459207800 x1875732254973440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837804.200906:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459207800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732254973440:0@lo:400: 00010000:00080000:1.0:1788837804.200935:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a459207b80 x1875732254973696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837804.200958:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459207b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254973696:0@lo:400: 00000100:00100000:1.0:1788837804.200976:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254973824 00000100:00100000:1.0:1788837804.200979:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254973824 00000100:00100000:1.0:1788837804.201006:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788837804.201012:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459205500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3272:x1875732254973824:12345-0@lo:400: 00000100:00100000:1.0:1788837804.201049:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459205500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3272:x1875732254973824:12345-0@lo:400: Request processed in 37us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837804.201055:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788837804.201070:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788837804.201087:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a459204700 x1875732254973824/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837804.201097:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459204700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3272:1875732254973824:0@lo:400: 00000100:00100000:2.0:1788837804.202027:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254973312 00000100:00100000:2.0:1788837804.202040:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254973312 00000100:00100000:2.0:1788837804.202089:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788837804.202099:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3272:x1875732254973312:12345-0@lo:400: 00000100:00100000:2.0:1788837804.202177:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3272:x1875732254973312:12345-0@lo:400: Request processed in 79us (1580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837804.202185:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788837804.202321:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459206300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732254973312:0@lo:400: 00010000:00010000:0.0:1788837804.582064:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837805.575169:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837805.576424:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240269696 00000100:00100000:1.0:1788837805.576446:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240269696 00000100:00100000:1.0:1788837805.576538:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 113 00000100:00100000:1.0:1788837805.576549:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2348:x1875732240269696:12345-192.168.204.54@tcp:250: 00010000:00080000:1.0:1788837805.576601:0:5800:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a92c8dcb-08c4-4855-9620-ea86c948f6f2@192.168.204.54@tcp t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:1.0:1788837805.576644:0:5800:0:(genops.c:1385:class_connect()) connect: client a92c8dcb-08c4-4855-9620-ea86c948f6f2, cookie 0x2deb895b363e62ca 00000100:00080000:1.0:1788837805.577016:0:5800:0:(import.c:65:import_set_state_nolock()) ffff97a344925800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788837805.577192:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+5:2348:x1875732240269696:12345-192.168.204.54@tcp:250: Request processed in 641us (2037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837805.577251:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 113 00000100:00100000:2.0:1788837805.589766:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837805.589938:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240269568 00000100:00100000:0.0:1788837805.589954:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240269568 00000100:00100000:0.0:1788837805.590034:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 114 00000100:00100000:0.0:1788837805.590046:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+5:5577:x1875732240269568:12345-192.168.204.54@tcp:101: 00010000:00010000:0.0:1788837805.590070:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837805.590094:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a440031a00/0x2deb895b363e62d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0ce9c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837805.590133:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a440031a00/0x2deb895b363e62d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0ce9c expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837805.590146:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a440031a00/0x2deb895b363e62d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0ce9c expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837805.590157:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a440031a00, rc 0) 00000100:00100000:0.0:1788837805.590397:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+6:5577:x1875732240269568:12345-192.168.204.54@tcp:101: Request processed in 352us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837805.590405:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 114 00000100:00100000:3.0:1788837805.597103:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837805.597392:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240269824 00000100:00100000:2.0:1788837805.597407:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240269824 00000100:00100000:2.0:1788837805.597546:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 115 00000100:00100000:2.0:1788837805.597560:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+6:5577:x1875732240269824:12345-192.168.204.54@tcp:501: 00000100:00100000:2.0:1788837805.598062:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+6:5577:x1875732240269824:12345-192.168.204.54@tcp:501: Request processed in 502us (974us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788837805.598073:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 115 00010000:00010000:3.0:1788837805.602541:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837805.603660:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837805.612792:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240269952 00000100:00100000:0.0:1788837805.612817:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240269952 00000100:00100000:0.0:1788837805.615812:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00100000:0.0:1788837805.615842:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+6:5577:x1875732240269952:12345-192.168.204.54@tcp:101: 00010000:00010000:0.0:1788837805.615867:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837805.615896:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a440030a00/0x2deb895b363e62d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0cea3 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837805.615941:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a440030a00/0x2deb895b363e62d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cea3 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837805.615978:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a440030a00/0x2deb895b363e62d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cea3 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837805.615990:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a440030a00, rc 0) 00000100:00100000:0.0:1788837805.616091:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+7:5577:x1875732240269952:12345-192.168.204.54@tcp:101: Request processed in 265us (12445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837805.616098:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00100000:1.0:1788837805.620566:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837805.623631:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240270080 00000100:00100000:0.0:1788837805.623652:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240270080 00000100:00100000:1.0:1788837805.625382:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:1.0:1788837805.625629:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+7:5577:x1875732240270080:12345-192.168.204.54@tcp:501: 00000100:00100000:1.0:1788837805.626158:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+8:5577:x1875732240270080:12345-192.168.204.54@tcp:501: Request processed in 756us (5603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837805.626169:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:0.0:1788837805.635435:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837805.635727:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240270208 00000100:00100000:1.0:1788837805.635742:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240270208 00000100:00100000:1.0:1788837805.635816:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00100000:1.0:1788837805.635829:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+8:5577:x1875732240270208:12345-192.168.204.54@tcp:503: 00000100:00100000:1.0:1788837805.638072:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+8:5577:x1875732240270208:12345-192.168.204.54@tcp:503: Request processed in 2224us (2631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837805.638092:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00100000:3.0:1788837805.653383:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837805.653587:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240270336 00000100:00100000:1.0:1788837805.653601:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240270336 00000100:00100000:1.0:1788837805.653677:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 119 00000100:00100000:1.0:1788837805.653697:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+8:5596:x1875732240270336:12345-192.168.204.54@tcp:502: 00000100:00100000:1.0:1788837805.654395:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+8:5596:x1875732240270336:12345-192.168.204.54@tcp:502: Request processed in 704us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837805.654550:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 119 00000100:00100000:2.0:1788837805.693175:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837805.696091:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240270464 00000100:00100000:1.0:1788837805.696115:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240270464 00000100:00100000:2.0:1788837805.696980:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00100000:2.0:1788837805.697004:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+8:5596:x1875732240270464:12345-192.168.204.54@tcp:502: 00000100:00100000:2.0:1788837805.699038:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+8:5596:x1875732240270464:12345-192.168.204.54@tcp:502: Request processed in 2029us (5863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837805.699071:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00100000:0.0:1788837805.703599:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837805.703817:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240270592 00000100:00100000:2.0:1788837805.703840:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240270592 00000100:00100000:2.0:1788837805.703923:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 121 00000100:00100000:2.0:1788837805.703935:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+8:5577:x1875732240270592:12345-192.168.204.54@tcp:101: 00010000:00010000:2.0:1788837805.703958:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837805.703986:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a441464e00/0x2deb895b363e62df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0cecd expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837805.704024:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a441464e00/0x2deb895b363e62df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cecd expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837805.704038:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a441464e00/0x2deb895b363e62df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cecd expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837805.704051:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a441464e00, rc 0) 00000100:00100000:2.0:1788837805.704247:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+9:5577:x1875732240270592:12345-192.168.204.54@tcp:101: Request processed in 260us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837805.704256:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 121 00000100:00100000:2.0:1788837805.718650:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837805.718847:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240270720 00000100:00100000:0.0:1788837805.718863:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240270720 00000100:00100000:0.0:1788837805.718948:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00100000:0.0:1788837805.718961:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+9:5577:x1875732240270720:12345-192.168.204.54@tcp:256: 20000000:01000000:0.0:1788837805.719001:0:5800:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788837805.719037:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788837805.719042:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788837805.719045:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788837805.719047:0:5800:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788837805.730569:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+9:5577:x1875732240270720:12345-192.168.204.54@tcp:256: Request processed in 11592us (11917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837805.730587:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00100000:1.0:1788837805.742417:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837805.742708:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240270848 00000100:00100000:2.0:1788837805.742723:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240270848 00000100:00100000:2.0:1788837805.742800:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 123 00000100:00100000:2.0:1788837805.742814:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4551a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+9:5577:x1875732240270848:12345-192.168.204.54@tcp:101: 00010000:00010000:2.0:1788837805.743003:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837805.743032:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a441464600/0x2deb895b363e62e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0ced4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837805.743094:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a441464600/0x2deb895b363e62e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0ced4 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837805.743107:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a441464600/0x2deb895b363e62e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0ced4 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837805.743118:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a441464600, rc 0) 00000100:00100000:2.0:1788837805.743290:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4551a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:5577:x1875732240270848:12345-192.168.204.54@tcp:101: Request processed in 479us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837805.743298:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 123 00000100:00100000:3.0:1788837805.748367:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837805.748465:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240270976 00000100:00100000:0.0:1788837805.748479:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240270976 00000100:00100000:0.0:1788837805.748574:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 124 00000100:00100000:0.0:1788837805.748588:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4551ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:5577:x1875732240270976:12345-192.168.204.54@tcp:501: 00000100:00100000:0.0:1788837805.750762:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4551ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:5577:x1875732240270976:12345-192.168.204.54@tcp:501: Request processed in 2159us (2394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837805.750780:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 124 00000100:00100000:1.0:1788837805.757992:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837805.758187:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240271104 00000100:00100000:3.0:1788837805.758231:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240271104 00000100:00100000:3.0:1788837805.758307:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 125 00000100:00100000:3.0:1788837805.758318:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4551a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:5577:x1875732240271104:12345-192.168.204.54@tcp:503: 00000100:00100000:3.0:1788837805.759076:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4551a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:5577:x1875732240271104:12345-192.168.204.54@tcp:503: Request processed in 754us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837805.759088:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 125 00000100:00100000:1.0:1788837805.764862:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837805.765026:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240271232 00000100:00100000:0.0:1788837805.765039:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240271232 00000100:00100000:0.0:1788837805.765116:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 126 00000100:00100000:0.0:1788837805.765128:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a460089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:5600:x1875732240271232:12345-192.168.204.54@tcp:502: 00000100:00100000:0.0:1788837805.765533:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a460089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:5600:x1875732240271232:12345-192.168.204.54@tcp:502: Request processed in 404us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837805.765543:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 126 00000100:00100000:0.0:1788837805.768729:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837805.769013:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240271360 00000100:00100000:1.0:1788837805.769028:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240271360 00000100:00100000:1.0:1788837805.769114:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 127 00000100:00100000:1.0:1788837805.769127:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a460088c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:5600:x1875732240271360:12345-192.168.204.54@tcp:502: 00000100:00100000:1.0:1788837805.769518:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a460088c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:5600:x1875732240271360:12345-192.168.204.54@tcp:502: Request processed in 391us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837805.769528:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 127 00000100:00100000:0.0:1788837805.774470:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837805.775084:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240271488 00000100:00100000:1.0:1788837805.775099:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240271488 00000100:00100000:1.0:1788837805.775175:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:1.0:1788837805.775185:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2348:x1875732240271488:12345-192.168.204.54@tcp:38: 00010000:00080000:0.0:1788837805.775908:0:5808:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7@192.168.204.54@tcp t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:0.0:1788837805.775978:0:5808:0:(genops.c:1385:class_connect()) connect: client f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7, cookie 0x2deb895b363e62ed 00000004:00100000:0.0:1788837805.776019:0:5808:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788837805.776027:0:5808:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1788837805.845640:0:5808:0:(import.c:65:import_set_state_nolock()) ffff97a344920000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788837805.846066:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2348:x1875732240271488:12345-192.168.204.54@tcp:38: Request processed in 70877us (71609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837805.846080:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00010000:00010000:2.0:1788837806.630303:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837806.852941:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837806.853084:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240271744 00000100:00100000:0.0:1788837806.853100:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240271744 00000100:00100000:0.0:1788837806.853262:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:0.0:1788837806.853278:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:5577:x1875732240271744:12345-192.168.204.54@tcp:41: 00000100:00100000:3.0:1788837806.853310:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000004:00000024:0.0:1788837806.853341:0:5809:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788837806.853548:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240271616 00000100:00100000:2.0:1788837806.853554:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240271616 00000100:00100000:2.0:1788837806.853589:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:2.0:1788837806.853596:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:0:x1875732240271616:12345-192.168.204.54@tcp:41: 00000004:00000024:2.0:1788837806.853610:0:7972:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788837806.853713:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:0:x1875732240271616:12345-192.168.204.54@tcp:41: Request processed in 117us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837806.853722:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:0.0:1788837806.854765:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:5577:x1875732240271744:12345-192.168.204.54@tcp:41: Request processed in 1478us (1826us total) trans 0 rc 0/0 00000100:00080000:1.0:1788837806.854775:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837806.854782:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:3.0:1788837806.861594:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837806.861849:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240271872 00000100:00100000:1.0:1788837806.861863:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240271872 00000100:00100000:1.0:1788837806.861947:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:1.0:1788837806.861961:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:5577:x1875732240271872:12345-192.168.204.54@tcp:40: 00000100:00100000:1.0:1788837806.862094:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:5577:x1875732240271872:12345-192.168.204.54@tcp:40: Request processed in 135us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837806.862103:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:2.0:1788837806.873886:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837806.873952:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837806.873993:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837806.874095:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240272256 00000100:00100000:1.0:1788837806.874107:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240272384 00000100:00100000:1.0:1788837806.874123:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240272384 00000100:00100000:0.0:1788837806.874129:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240272256 00000100:00100000:1.0:1788837806.874261:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 128 00000100:00100000:0.0:1788837806.874262:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:1.0:1788837806.874297:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:2352:x1875732240272384:12345-192.168.204.54@tcp:400: 00000100:00100000:0.0:1788837806.874297:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:5577:x1875732240272256:12345-192.168.204.54@tcp:33: 00000100:00100000:1.0:1788837806.874412:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:2352:x1875732240272384:12345-192.168.204.54@tcp:400: Request processed in 131us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837806.874422:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 128 00000100:00100000:0.0:1788837806.876498:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240272512 00000100:00100000:0.0:1788837806.876513:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240272512 00000100:00100000:0.0:1788837806.876608:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:0.0:1788837806.876621:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2352:x1875732240272512:12345-192.168.204.54@tcp:400: 00000100:00100000:0.0:1788837806.876719:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2352:x1875732240272512:12345-192.168.204.54@tcp:400: Request processed in 99us (2849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837806.876728:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:3.0:1788837806.876796:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837806.876914:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837806.876995:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240272000 00000100:00100000:3.0:1788837806.877003:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240272000 00000100:00100000:3.0:1788837806.877039:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240272128 00000100:00100000:3.0:1788837806.877042:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240272128 00000100:00100000:3.0:1788837806.877079:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:3.0:1788837806.877086:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1875732240272000:12345-192.168.204.54@tcp:8: 00010000:00080000:3.0:1788837806.877126:0:6653:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7@192.168.204.54@tcp t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:3.0:1788837806.877170:0:6653:0:(genops.c:1385:class_connect()) connect: client f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7, cookie 0x2deb895b363e62f4 00002000:00100000:3.0:1788837806.877188:0:6653:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7/ffff97a449445000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113975 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788837806.877254:0:6653:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788837806.877394:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:2.0:1788837806.877405:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1875732240272128:12345-192.168.204.54@tcp:8: 00010000:00080000:2.0:1788837806.877439:0:6650:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7@192.168.204.54@tcp t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:2.0:1788837806.877507:0:6650:0:(genops.c:1385:class_connect()) connect: client f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7, cookie 0x2deb895b363e62fb 00002000:00100000:2.0:1788837806.877521:0:6650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7/ffff97a34602b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113975 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788837806.877553:0:6650:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788837806.877857:0:6653:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788837806.877907:0:6653:0:(import.c:65:import_set_state_nolock()) ffff97a449445800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837806.877990:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2348:x1875732240272000:12345-192.168.204.54@tcp:8: Request processed in 900us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837806.877999:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00002000:00080000:2.0:1788837806.878351:0:6650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788837806.878391:0:6650:0:(import.c:65:import_set_state_nolock()) ffff97a346028800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788837806.878461:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2348:x1875732240272128:12345-192.168.204.54@tcp:8: Request processed in 1055us (1545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837806.878470:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000004:00080000:2.0:1788837806.902921:0:5811:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 28531us 00000004:00200000:3.0:1788837806.926880:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788837806.927006:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:5577:x1875732240272256:12345-192.168.204.54@tcp:33: Request processed in 52722us (53006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837806.927020:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:3.0:1788837807.121715:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837807.121992:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240272640 00000100:00100000:1.0:1788837807.122006:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240272640 00000100:00100000:1.0:1788837807.122129:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:1.0:1788837807.122142:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:5617:x1875732240272640:12345-192.168.204.54@tcp:101: 00010000:00010000:1.0:1788837807.122171:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837807.122749:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a441667800/0x2deb895b363e6302 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0cefe expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837807.123387:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e6309 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837807.123406:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e6309 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837807.123423:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e6309 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837807.123466:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788837807.123470:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788837807.123502:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e6309 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837807.123670:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a441667800/0x2deb895b363e6302 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cefe expref: 8 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837807.123694:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e6309 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cefe expref: 7 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837807.123704:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a45487fc00) 00010000:00010000:1.0:1788837807.123707:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788837807.123719:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3d400, rc 0) 00000100:00100000:1.0:1788837807.127224:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:5617:x1875732240272640:12345-192.168.204.54@tcp:101: Request processed in 5044us (5486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837807.127238:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00010000:00010000:2.0:1788837807.651035:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837807.778541:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837807.782897:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254973952:0@lo:13: 00000100:00100000:2.0:1788837807.783150:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837807.784536:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254973952 00000100:00100000:0.0:1788837807.784554:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254973952 00000100:00100000:0.0:1788837807.784671:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788837807.784686:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254973952:12345-0@lo:13: 00002000:00000024:0.0:1788837807.784721:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837807.784824:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254973952:12345-0@lo:13: Request processed in 142us (1674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837807.784831:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788837807.784919:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788837807.785134:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a458c92680 x1875732254973952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837807.785161:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254973952:0@lo:13: 00010000:00010000:0.0:1788837808.678304:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837809.314627:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837809.314669:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459204700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254974080:0@lo:13: 00000100:00100000:1.0:1788837809.314778:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837809.315282:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254974592:0@lo:400: 00000100:00100000:2.0:1788837809.315325:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837809.315355:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837809.315361:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3274:1875732254974464:0@lo:400: 00000100:00100000:2.0:1788837809.315389:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837809.315475:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3272:1875732254974336:0@lo:400: 00000100:00100000:3.0:1788837809.315511:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837809.315589:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788837809.315596:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732254974208:0@lo:400: 00000100:00100000:3.0:1788837809.315637:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837809.315671:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3272:1875732254974720:0@lo:400: 00000100:00100000:3.0:1788837809.315692:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837809.321663:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254974080 00000100:00100000:0.0:1788837809.321689:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254974080 00000100:00100000:0.0:1788837809.321813:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788837809.321827:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459207b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254974080:12345-0@lo:13: 00002000:00000024:0.0:1788837809.325121:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837809.327560:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459207b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254974080:12345-0@lo:13: Request processed in 5720us (12765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837809.327583:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788837809.327684:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254974208 00000100:00100000:0.0:1788837809.327696:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254974208 00000100:00100000:0.0:1788837809.327751:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788837809.327762:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3272:x1875732254974208:12345-0@lo:400: 00000100:00100000:0.0:1788837809.327837:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3272:x1875732254974208:12345-0@lo:400: Request processed in 77us (12199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837809.327843:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:0.0:1788837809.327883:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788837809.327948:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a459204700 x1875732254974080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837825 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837809.327975:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459204700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254974080:0@lo:13: 00000100:00100000:0.0:1788837809.331476:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254974592 00000100:00100000:0.0:1788837809.331500:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254974592 00000100:00100000:0.0:1788837809.331616:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788837809.331628:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254974592:12345-0@lo:400: 00000100:00100000:0.0:1788837809.331767:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254974592:12345-0@lo:400: Request processed in 141us (16441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837809.331775:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788837809.331803:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837809.335001:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254974464 00000100:00100000:2.0:1788837809.335025:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254974464 00010000:00080000:2.0:1788837809.335417:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a44a40b100 x1875732254974592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837809.335449:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254974592:0@lo:400: 00000100:00080000:2.0:1788837809.335610:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837809.335640:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837809.338869:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732254974208:0@lo:400: 00000100:00100000:1.0:1788837809.345925:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254974336 00000100:00100000:1.0:1788837809.345950:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254974336 00000100:00100000:1.0:1788837809.346001:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254974720 00000100:00100000:1.0:1788837809.346005:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254974720 00000100:00100000:1.0:1788837809.346095:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240272768 00000100:00100000:1.0:1788837809.346098:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240272768 00000100:00100000:1.0:1788837809.346130:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788837809.346142:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1875732254974464:12345-0@lo:400: 00000100:00100000:1.0:1788837809.346310:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1875732254974464:12345-0@lo:400: Request processed in 169us (30918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837809.346318:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788837809.346340:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788837809.346346:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3272:x1875732254974720:12345-0@lo:400: 00000100:00100000:1.0:1788837809.346388:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3272:x1875732254974720:12345-0@lo:400: Request processed in 41us (30694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837809.346394:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788837809.346413:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:1.0:1788837809.346421:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:5669:x1875732240272768:12345-192.168.204.54@tcp:41: 00000004:00000024:1.0:1788837809.346502:0:5808:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788837809.346567:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:5669:x1875732240272768:12345-192.168.204.54@tcp:41: Request processed in 146us (10932us total) trans 0 rc 0/0 00000100:00080000:3.0:1788837809.347154:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837809.347243:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3272:1875732254974720:0@lo:400: 00000100:00100000:1.0:1788837809.348513:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:0.0:1788837809.348521:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3274:1875732254974464:0@lo:400: 00000100:00100000:0.0:1788837809.348609:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788837809.348621:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1875732254974336:12345-0@lo:400: 00000100:00100000:0.0:1788837809.348723:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1875732254974336:12345-0@lo:400: Request processed in 104us (33210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837809.348731:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788837809.348764:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3272:1875732254974336:0@lo:400: 00000100:00100000:3.0:1788837809.352502:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837809.352615:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240272896 00000100:00100000:0.0:1788837809.352661:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240272896 00000100:00100000:0.0:1788837809.352767:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:0.0:1788837809.352779:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:5669:x1875732240272896:12345-192.168.204.54@tcp:13: 00002000:00000024:0.0:1788837809.352835:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837809.352933:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:5669:x1875732240272896:12345-192.168.204.54@tcp:13: Request processed in 155us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837809.352941:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00080000:3.0:1788837809.353044:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837809.357938:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837809.358119:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240273024 00000100:00100000:2.0:1788837809.358349:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240273024 00000100:00100000:2.0:1788837809.358563:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:2.0:1788837809.358577:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459207800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:5669:x1875732240273024:12345-192.168.204.54@tcp:13: 00002000:00000024:2.0:1788837809.358618:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837809.358727:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459207800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:5669:x1875732240273024:12345-192.168.204.54@tcp:13: Request processed in 153us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837809.358735:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00080000:3.0:1788837809.364006:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788837809.698837:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788837809.978094:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7 00000001:00100000:1.0:1788837810.412597:0:7611:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7 00010000:00010000:2.0:1788837810.726136:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788837810.914013:0:5830:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7 00010000:00010000:0.0:1788837811.751254:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837811.912537:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837811.912573:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837811.912603:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837811.912627:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837811.913242:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240273280 00000100:00100000:1.0:1788837811.913254:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240273280 00000100:00100000:1.0:1788837811.913320:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:1.0:1788837811.913331:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2352:x1875732240273280:12345-192.168.204.54@tcp:400: 00000100:00100000:1.0:1788837811.913425:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2352:x1875732240273280:12345-192.168.204.54@tcp:400: Request processed in 96us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837811.913433:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00080000:1.0:1788837811.913456:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837811.913599:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240273536 00000100:00100000:1.0:1788837811.913604:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240273536 00000100:00100000:1.0:1788837811.913639:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240273408 00000100:00100000:1.0:1788837811.913642:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240273408 00000100:00100000:1.0:1788837811.913661:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:1.0:1788837811.913667:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2352:x1875732240273536:12345-192.168.204.54@tcp:400: 00000100:00100000:1.0:1788837811.913700:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2352:x1875732240273536:12345-192.168.204.54@tcp:400: Request processed in 33us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837811.913706:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:1.0:1788837811.913719:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:1.0:1788837811.913725:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2352:x1875732240273408:12345-192.168.204.54@tcp:400: 00000100:00100000:1.0:1788837811.913750:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2352:x1875732240273408:12345-192.168.204.54@tcp:400: Request processed in 25us (1121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837811.913772:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00080000:1.0:1788837811.913789:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788837811.913792:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837811.919483:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240273152 00000100:00100000:2.0:1788837811.919506:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240273152 00000100:00100000:2.0:1788837811.919579:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 130 00000100:00100000:2.0:1788837811.919590:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a56a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:2352:x1875732240273152:12345-192.168.204.54@tcp:400: 00000100:00100000:2.0:1788837811.919680:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a56a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:2352:x1875732240273152:12345-192.168.204.54@tcp:400: Request processed in 92us (7075us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837811.919688:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 130 00000001:02000400:1.0:1788837812.352957:0:8269:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788837812.770826:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837812.898698:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254974848:0@lo:13: 00000100:00100000:3.0:1788837812.898789:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837812.898978:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254974848 00000100:00100000:1.0:1788837812.898987:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254974848 00000100:00100000:1.0:1788837812.899076:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788837812.899086:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732254974848:12345-0@lo:13: 00002000:00000024:1.0:1788837812.899134:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788837812.899257:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837812.907508:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732254974848:12345-0@lo:13: Request processed in 8410us (8705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837812.907524:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788837812.907715:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a458c91f80 x1875732254974848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837812.907741:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254974848:0@lo:13: 00010000:00010000:3.0:1788837813.800689:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837814.435540:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788837814.435570:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254974976:0@lo:13: 00000100:00100000:0.0:1788837814.435644:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837814.435711:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254974976 00000100:00100000:0.0:1788837814.435718:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254974976 00000100:00100000:0.0:1788837814.435785:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788837814.435794:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254974976:12345-0@lo:13: 00002000:00000024:0.0:1788837814.435827:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837814.435870:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254974976:12345-0@lo:13: Request processed in 77us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837814.435877:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788837814.435898:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788837814.435927:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a458c93100 x1875732254974976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837830 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837814.435945:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254974976:0@lo:13: 00000100:00100000:0.0:1788837814.436761:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254975488:0@lo:400: 00000100:00100000:0.0:1788837814.436808:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837814.436850:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788837814.436857:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732254975104:0@lo:400: 00000100:00100000:0.0:1788837814.436885:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837814.436909:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732254975616:0@lo:400: 00000100:00100000:0.0:1788837814.436934:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837814.436959:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732254975232:0@lo:400: 00000100:00100000:0.0:1788837814.436996:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837814.437021:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837814.437027:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732254975360:0@lo:400: 00000100:00100000:0.0:1788837814.437050:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837814.437077:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254975104 00000100:00100000:0.0:1788837814.437083:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254975104 00000100:00100000:0.0:1788837814.437130:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788837814.437138:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a56b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3273:x1875732254975104:12345-0@lo:400: 00000100:00100000:0.0:1788837814.437175:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a56b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3273:x1875732254975104:12345-0@lo:400: Request processed in 38us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837814.437182:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788837814.437232:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254975616 00000100:00100000:0.0:1788837814.437236:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254975616 00000100:00100000:0.0:1788837814.437269:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254975232 00000100:00100000:0.0:1788837814.437273:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254975232 00000100:00100000:0.0:1788837814.437284:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254975360 00000100:00100000:0.0:1788837814.437287:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254975360 00000100:00100000:0.0:1788837814.437300:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788837814.437305:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1875732254975616:12345-0@lo:400: 00000100:00100000:0.0:1788837814.437468:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1875732254975616:12345-0@lo:400: Request processed in 30us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837814.437475:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788837814.437493:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788837814.437499:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732254975232:12345-0@lo:400: 00000100:00100000:0.0:1788837814.437672:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732254975232:12345-0@lo:400: Request processed in 172us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837814.437679:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788837814.437692:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788837814.437699:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732254975360:12345-0@lo:400: 00000100:00100000:0.0:1788837814.437723:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732254975360:12345-0@lo:400: Request processed in 26us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837814.437729:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1788837814.437745:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837814.437771:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732254975104:0@lo:400: 00000100:00100000:0.0:1788837814.437784:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732254975616:0@lo:400: 00000100:00100000:3.0:1788837814.441215:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732254975360:0@lo:400: 00000100:00100000:3.0:1788837814.441250:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732254975232:0@lo:400: 00000100:00100000:1.0:1788837814.441496:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254975488 00000100:00100000:1.0:1788837814.441504:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254975488 00000100:00100000:1.0:1788837814.441571:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788837814.441581:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254975488:12345-0@lo:400: 00000100:00100000:1.0:1788837814.441670:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254975488:12345-0@lo:400: Request processed in 92us (4861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837814.441677:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788837814.441722:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a458c90a80 x1875732254975488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837814.441733:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254975488:0@lo:400: 00000100:00080000:0.0:1788837814.441941:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788837814.819436:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837815.844710:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788837816.313960:0:8417:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd1d0c1320 20000000:00000080:1.0:1788837816.313984:0:8417:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97a46e6db000 uarg=0000000000000000 20000000:01000000:1.0:1788837816.314027:0:8417:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788837816.314029:0:8417:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788837816.314032:0:8417:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788837816.314054:0:8417:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788837816.314060:0:8417:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788837816.314079:0:8417:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788837816.314082:0:8417:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788837816.314383:0:8417:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788837816.314387:0:8417:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788837816.323265:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1788837816.324129:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1788837816.324185:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1788837816.324330:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1788837816.324343:0:8417:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788837816.324346:0:8417:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788837816.325339:0:8419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1788837816.325949:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1788837816.326018:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1788837816.326056:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1788837816.326071:0:8417:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788837816.326074:0:8417:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788837816.326972:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1788837816.327499:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1788837816.327550:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1788837816.327588:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1788837816.327601:0:8417:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788837816.327604:0:8417:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788837816.330835:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1788837816.331407:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1788837816.331480:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1788837816.331520:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:3.0:1788837816.331537:0:8417:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788837816.331556:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a44a48b000/0x2deb895b363e6310 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837816.331576:0:8417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a441667e00/0x2deb895b363e620d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e6206 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837816.331585:0:8417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a441666600/0x2deb895b363e6237 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e6230 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837816.331592:0:8417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a440030600/0x2deb895b363e6261 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e625a expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837816.331599:0:8417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a44a48be00/0x2deb895b363e626f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e6268 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837816.331606:0:8417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a441464000/0x2deb895b363e627d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e6276 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837816.331611:0:8417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a441667000/0x2deb895b363e6299 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e6292 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837816.331617:0:8417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a441464400/0x2deb895b363e62c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e62bc expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837816.331750:0:8417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a440031a00/0x2deb895b363e62d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0ce9c expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837816.331767:0:8417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a440030a00/0x2deb895b363e62d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cea3 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837816.331776:0:8417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a44a48b000/0x2deb895b363e6310 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837816.331822:0:8417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a440030a00/0x2deb895b363e62d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cea3 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837816.331841:0:8417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a440030a00/0x2deb895b363e62d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cea3 expref: 9 pid: 5802 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837816.331858:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1875732254975744:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788837816.332019:0:8417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a440031a00/0x2deb895b363e62d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0ce9c expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837816.332027:0:8417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a440031a00/0x2deb895b363e62d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0ce9c expref: 9 pid: 5802 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837816.332036:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4bb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1875732254975872:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788837816.332085:0:8417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a441464400/0x2deb895b363e62c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e62bc expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837816.332093:0:8417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a441464400/0x2deb895b363e62c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e62bc expref: 18 pid: 5802 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837816.332103:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1875732254976000:0@lo:104: 00000100:00100000:3.0:1788837816.332150:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788837816.332195:0:8417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a441667000/0x2deb895b363e6299 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e6292 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837816.332221:0:8417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a441667000/0x2deb895b363e6299 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e6292 expref: 18 pid: 5802 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837816.332230:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1875732254976128:0@lo:104: 00000100:00100000:3.0:1788837816.332257:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788837816.332279:0:8417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a441464000/0x2deb895b363e627d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e6276 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837816.332288:0:8417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a441464000/0x2deb895b363e627d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e6276 expref: 18 pid: 5803 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837816.332296:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1875732254976256:0@lo:104: 00010000:00010000:3.0:1788837816.332332:0:8417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a44a48be00/0x2deb895b363e626f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e6268 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837816.332340:0:8417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a44a48be00/0x2deb895b363e626f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e6268 expref: 18 pid: 5802 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837816.332347:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1875732254976384:0@lo:104: 00010000:00010000:3.0:1788837816.332370:0:8417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a440030600/0x2deb895b363e6261 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e625a expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837816.332378:0:8417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a440030600/0x2deb895b363e6261 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e625a expref: 18 pid: 5802 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837816.332385:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1875732254976512:0@lo:104: 00010000:00010000:3.0:1788837816.332403:0:8417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a441666600/0x2deb895b363e6237 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e6230 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837816.332417:0:8417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a441666600/0x2deb895b363e6237 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e6230 expref: 18 pid: 5800 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837816.332425:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1875732254976640:0@lo:104: 00010000:00010000:3.0:1788837816.332447:0:8417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a441667e00/0x2deb895b363e620d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e6206 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837816.332455:0:8417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a441667e00/0x2deb895b363e620d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e6206 expref: 18 pid: 5800 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837816.332462:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1875732254976768:0@lo:104: 00000100:00100000:3.0:1788837816.332475:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4590d96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837816.332571:0:5792:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788837816.332589:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837816.332601:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837816.332608:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837816.332615:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837816.332622:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837816.332643:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254976000 00000100:00100000:2.0:1788837816.332649:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254976000 00000100:00100000:2.0:1788837816.332688:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254976128 00000100:00100000:2.0:1788837816.332691:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254976128 00000100:00100000:2.0:1788837816.332701:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254976256 00000100:00100000:2.0:1788837816.332704:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254976256 00000100:00100000:2.0:1788837816.332713:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254976384 00000100:00100000:2.0:1788837816.332715:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254976384 00000100:00100000:2.0:1788837816.332722:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254976512 00000100:00100000:2.0:1788837816.332725:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254976512 00000100:00100000:2.0:1788837816.332733:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254976640 00000100:00100000:2.0:1788837816.332736:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254976640 00000100:00100000:2.0:1788837816.332745:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254976768 00000100:00100000:2.0:1788837816.332747:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254976768 00000100:00100000:2.0:1788837816.332760:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788837816.332770:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+9:8417:x1875732254976000:12345-0@lo:104: 00010000:00010000:2.0:1788837816.332783:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a441465800/0x2deb895b363e62bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e62c3 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837816.332903:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1875732254976000:0@lo:104: 00010000:00010000:2.0:1788837816.333448:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788837816.333457:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+9:8417:x1875732254976000:12345-0@lo:104: Request processed in 688us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837816.333466:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788837816.333490:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788837816.333499:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a449b16850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+8:8417:x1875732254976128:12345-0@lo:104: 00010000:00010000:2.0:1788837816.333517:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a44a48ba00/0x2deb895b363e6292 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e6299 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837816.333576:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788837816.333582:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a449b16850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+8:8417:x1875732254976128:12345-0@lo:104: Request processed in 86us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837816.333589:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1788837816.333712:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788837816.333720:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a441465800/0x2deb895b363e62bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e62c3 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.333728:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441465800 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:1.0:1788837816.333732:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a441465800/0x2deb895b363e62bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e62c3 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.333742:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a441465800/0x2deb895b363e62bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e62c3 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837816.333749:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a441465800/0x2deb895b363e62bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e62c3 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837816.333755:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837816.333793:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a441465800/0x2deb895b363e62bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e62c3 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.333800:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837816.333823:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a441465800/0x2deb895b363e62bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e62c3 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.333841:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a441465800/0x2deb895b363e62bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e62c3 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.333855:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837816.333859:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a44a48ba00/0x2deb895b363e6292 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e6299 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.333864:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48ba00 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:1.0:1788837816.333867:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a44a48ba00/0x2deb895b363e6292 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e6299 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.333874:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a44a48ba00/0x2deb895b363e6292 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e6299 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837816.333880:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a44a48ba00/0x2deb895b363e6292 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e6299 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837816.333885:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837816.333901:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a44a48ba00/0x2deb895b363e6292 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e6299 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.333906:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837816.333911:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a44a48ba00/0x2deb895b363e6292 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e6299 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.333917:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a44a48ba00/0x2deb895b363e6292 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e6299 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.333926:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837816.333933:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837816.333935:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837816.333956:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459204e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732254976896:0@lo:103: 00000100:00100000:1.0:1788837816.333995:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837816.334033:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788837816.334039:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459204700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732254977024:0@lo:103: 00000100:00100000:1.0:1788837816.334075:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837816.334109:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254976896 00000100:00100000:1.0:1788837816.334115:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254976896 00010000:00010000:1.0:1788837816.334139:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a441464400/0x2deb895b363e62c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e62bc expref: 19 pid: 5802 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837816.334160:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254977024 00000100:00100000:1.0:1788837816.334163:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254977024 00010000:00010000:1.0:1788837816.334172:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a441667000/0x2deb895b363e6299 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e6292 expref: 20 pid: 5802 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837816.334188:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788837816.334194:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459206300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+20:3271:x1875732254976896:12345-0@lo:103: 00010000:00010000:1.0:1788837816.334231:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837816.334236:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a441464400/0x2deb895b363e62c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e62bc expref: 20 pid: 5802 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.334248:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a441464400/0x2deb895b363e62c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e62bc expref: 20 pid: 5802 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.334265:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a441464400/0x2deb895b363e62c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e62bc expref: 20 pid: 5802 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.334279:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837816.334330:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459206300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3271:x1875732254976896:12345-0@lo:103: Request processed in 135us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837816.334349:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788837816.334363:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788837816.334369:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:3271:x1875732254977024:12345-0@lo:103: 00010000:00010000:1.0:1788837816.334377:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837816.334382:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a441667000/0x2deb895b363e6299 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e6292 expref: 18 pid: 5802 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.334390:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a441667000/0x2deb895b363e6299 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e6292 expref: 18 pid: 5802 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.334401:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837816.334422:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:3271:x1875732254977024:12345-0@lo:103: Request processed in 54us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837816.334429:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788837816.334469:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459204700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732254977024:0@lo:103: 00000100:00100000:1.0:1788837816.334478:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459204e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732254976896:0@lo:103: 00010000:00010000:3.0:1788837816.334841:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a441667000/0x2deb895b363e6299 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e6292 expref: 17 pid: 5802 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837816.334853:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1875732254976128:0@lo:104: 00000100:00100000:2.0:1788837816.334913:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788837816.334924:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+7:8417:x1875732254976256:12345-0@lo:104: 00010000:00010000:2.0:1788837816.334934:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a44a48a200/0x2deb895b363e6276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e627d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837816.334994:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788837816.335001:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+7:8417:x1875732254976256:12345-0@lo:104: Request processed in 80us (2411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837816.335007:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788837816.335025:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788837816.335032:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a408000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+6:8417:x1875732254976384:12345-0@lo:104: 00010000:00010000:2.0:1788837816.335040:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a440031600/0x2deb895b363e6268 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e626f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837816.335074:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788837816.335079:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a408000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+6:8417:x1875732254976384:12345-0@lo:104: Request processed in 48us (2477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837816.335084:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788837816.335097:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788837816.335103:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a409f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+5:8417:x1875732254976512:12345-0@lo:104: 00010000:00010000:2.0:1788837816.335118:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a441464c00/0x2deb895b363e625a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e6261 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837816.335149:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788837816.335155:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a409f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+5:8417:x1875732254976512:12345-0@lo:104: Request processed in 52us (2545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837816.335161:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788837816.335173:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788837816.335180:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+4:8417:x1875732254976640:12345-0@lo:104: 00010000:00010000:2.0:1788837816.335188:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6230 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e6237 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837816.335235:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788837816.335240:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+4:8417:x1875732254976640:12345-0@lo:104: Request processed in 61us (2624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837816.335246:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788837816.335259:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788837816.335265:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a409880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+3:8417:x1875732254976768:12345-0@lo:104: 00010000:00010000:2.0:1788837816.335273:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a441666200/0x2deb895b363e6206 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e620d expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837816.335312:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788837816.335317:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a409880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+3:8417:x1875732254976768:12345-0@lo:104: Request processed in 52us (2693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837816.335322:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788837816.335413:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1875732254976256:0@lo:104: 00000100:00100000:3.0:1788837816.335422:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1875732254976384:0@lo:104: 00000100:00100000:3.0:1788837816.335429:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1875732254976512:0@lo:104: 00000100:00100000:3.0:1788837816.335435:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1875732254976640:0@lo:104: 00000100:00100000:3.0:1788837816.335442:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1875732254976768:0@lo:104: 00010000:00010000:1.0:1788837816.335501:0:7597:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788837816.335507:0:7597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a44a48a200/0x2deb895b363e6276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e627d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.335514:0:7597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48a200 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:1.0:1788837816.335518:0:7597:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a44a48a200/0x2deb895b363e6276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e627d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.335526:0:7597:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a44a48a200/0x2deb895b363e6276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e627d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837816.335545:0:7597:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a44a48a200/0x2deb895b363e6276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e627d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837816.335551:0:7597:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837816.335588:0:7597:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a44a48a200/0x2deb895b363e6276 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e627d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.335594:0:7597:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837816.335615:0:7597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a44a48a200/0x2deb895b363e6276 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e627d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.335622:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a44a48a200/0x2deb895b363e6276 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e627d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.335744:0:7597:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788837816.335749:0:7597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a440031600/0x2deb895b363e6268 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e626f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.335756:0:7597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a440031600 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:1.0:1788837816.335759:0:7597:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a440031600/0x2deb895b363e6268 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e626f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.335766:0:7597:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a440031600/0x2deb895b363e6268 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e626f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837816.335773:0:7597:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a440031600/0x2deb895b363e6268 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e626f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837816.335779:0:7597:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837816.335842:0:7597:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a440031600/0x2deb895b363e6268 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e626f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.335849:0:7597:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837816.335854:0:7597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a440031600/0x2deb895b363e6268 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e626f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.335859:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a440031600/0x2deb895b363e6268 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e626f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.335870:0:7597:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788837816.335872:0:7597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a441464c00/0x2deb895b363e625a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e6261 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.335878:0:7597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441464c00 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:1.0:1788837816.335881:0:7597:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a441464c00/0x2deb895b363e625a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e6261 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.335888:0:7597:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a441464c00/0x2deb895b363e625a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e6261 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837816.335893:0:7597:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a441464c00/0x2deb895b363e625a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e6261 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837816.335898:0:7597:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788837816.335948:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788837816.335954:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6230 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e6237 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837816.335962:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441465400 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:0.0:1788837816.335965:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6230 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e6237 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837816.335971:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6230 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e6237 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837816.335978:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6230 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e6237 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837816.335990:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837816.336093:0:7597:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a441464c00/0x2deb895b363e625a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e6261 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.336100:0:7597:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788837816.336139:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732254977408:0@lo:103: 00000100:00100000:2.0:1788837816.336178:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788837816.336334:0:7597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a441464c00/0x2deb895b363e625a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e6261 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.336354:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a441464c00/0x2deb895b363e625a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e6261 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.336364:0:7597:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837816.336368:0:7597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a441666200/0x2deb895b363e6206 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e620d expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.336374:0:7597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441666200 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:1.0:1788837816.336377:0:7597:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a441666200/0x2deb895b363e6206 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e620d expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.336384:0:7597:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a441666200/0x2deb895b363e6206 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e620d expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837816.336390:0:7597:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a441666200/0x2deb895b363e6206 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e620d expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837816.336395:0:7597:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837816.336411:0:7597:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a441666200/0x2deb895b363e6206 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e620d expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.336417:0:7597:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788837816.336490:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837816.336498:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732254977536:0@lo:103: 00000100:00100000:2.0:1788837816.336524:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837816.336592:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254977408 00000100:00100000:3.0:1788837816.336600:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254977408 00010000:00010000:3.0:1788837816.336640:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a440030600/0x2deb895b363e6261 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e625a expref: 17 pid: 5802 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837816.336686:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254977536 00000100:00100000:3.0:1788837816.336690:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254977536 00010000:00010000:3.0:1788837816.336702:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a441667e00/0x2deb895b363e620d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e6206 expref: 18 pid: 5800 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837816.336722:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788837816.336729:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:3271:x1875732254977408:12345-0@lo:103: 00010000:00010000:3.0:1788837816.336741:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837816.336746:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a440030600/0x2deb895b363e6261 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e625a expref: 18 pid: 5802 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837816.336756:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a440030600/0x2deb895b363e6261 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e625a expref: 18 pid: 5802 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837816.336773:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a440030600/0x2deb895b363e6261 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e625a expref: 18 pid: 5802 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837816.336787:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837816.336820:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:3271:x1875732254977408:12345-0@lo:103: Request processed in 92us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837816.336827:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788837816.336845:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788837816.336852:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a409c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:3271:x1875732254977536:12345-0@lo:103: 00010000:00010000:3.0:1788837816.336859:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837816.336864:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a441667e00/0x2deb895b363e620d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e6206 expref: 16 pid: 5800 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837816.336872:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a441667e00/0x2deb895b363e620d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e6206 expref: 16 pid: 5800 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837816.336889:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a441667e00/0x2deb895b363e620d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e6206 expref: 16 pid: 5800 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837816.336898:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837816.336923:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a409c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:3271:x1875732254977536:12345-0@lo:103: Request processed in 72us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837816.336929:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788837816.336963:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732254977536:0@lo:103: 00000100:00100000:3.0:1788837816.336972:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732254977408:0@lo:103: 00010000:00010000:0.0:1788837816.337164:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6230 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e6237 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837816.337172:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837816.337177:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6230 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e6237 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837816.337184:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6230 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e6237 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837816.337196:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837816.337197:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837816.337221:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837816.337229:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837816.337449:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3274:1875732254977280:0@lo:103: 00000100:00100000:2.0:1788837816.337483:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837816.337513:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788837816.337520:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3274:1875732254977152:0@lo:103: 00000100:00100000:2.0:1788837816.337541:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837816.337556:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448f91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3274:1875732254977664:0@lo:103: 00000100:00100000:2.0:1788837816.337576:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837816.337595:0:7599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254977280 00000100:00100000:2.0:1788837816.337599:0:7599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254977280 00010000:00010000:2.0:1788837816.337615:0:7599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a44a48be00/0x2deb895b363e626f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e6268 expref: 15 pid: 5802 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837816.337639:0:7599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254977152 00000100:00100000:2.0:1788837816.337642:0:7599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254977152 00010000:00010000:2.0:1788837816.337653:0:7599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a441464000/0x2deb895b363e627d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e6276 expref: 16 pid: 5803 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837816.337663:0:7599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254977664 00000100:00100000:2.0:1788837816.337665:0:7599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254977664 00010000:00010000:2.0:1788837816.337675:0:7599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a441666600/0x2deb895b363e6237 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e6230 expref: 17 pid: 5800 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837816.337688:0:7599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788837816.337693:0:7599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a408700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:3274:x1875732254977280:12345-0@lo:103: 00010000:00010000:2.0:1788837816.337702:0:7599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837816.337706:0:7599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a44a48be00/0x2deb895b363e626f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e6268 expref: 17 pid: 5802 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837816.337722:0:7599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a44a48be00/0x2deb895b363e626f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e6268 expref: 17 pid: 5802 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837816.337732:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a44a48be00/0x2deb895b363e626f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e6268 expref: 17 pid: 5802 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837816.337742:0:7599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837816.337772:0:7599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a408700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:3274:x1875732254977280:12345-0@lo:103: Request processed in 79us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837816.337779:0:7599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788837816.337793:0:7599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788837816.337798:0:7599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:3274:x1875732254977152:12345-0@lo:103: 00010000:00010000:2.0:1788837816.337806:0:7599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837816.337810:0:7599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a441464000/0x2deb895b363e627d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e6276 expref: 15 pid: 5803 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837816.337818:0:7599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a441464000/0x2deb895b363e627d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e6276 expref: 15 pid: 5803 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837816.337828:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a441464000/0x2deb895b363e627d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e6276 expref: 15 pid: 5803 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837816.337836:0:7599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837816.337856:0:7599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:3274:x1875732254977152:12345-0@lo:103: Request processed in 58us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837816.337862:0:7599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788837816.337872:0:7599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788837816.337878:0:7599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4497d4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:3274:x1875732254977664:12345-0@lo:103: 00010000:00010000:2.0:1788837816.337891:0:7599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837816.337895:0:7599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a441666600/0x2deb895b363e6237 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e6230 expref: 13 pid: 5800 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837816.337904:0:7599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a441666600/0x2deb895b363e6237 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e6230 expref: 13 pid: 5800 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837816.337913:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a441666600/0x2deb895b363e6237 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e6230 expref: 13 pid: 5800 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837816.337923:0:7599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837816.337944:0:7599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4497d4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:3274:x1875732254977664:12345-0@lo:103: Request processed in 67us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837816.337950:0:7599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788837816.338006:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3274:1875732254977152:0@lo:103: 00000100:00100000:2.0:1788837816.338014:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448f91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3274:1875732254977664:0@lo:103: 00000100:00100000:2.0:1788837816.338021:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3274:1875732254977280:0@lo:103: 00010000:00010000:2.0:1788837816.338042:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837816.340819:0:7597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a441666200/0x2deb895b363e6206 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e620d expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.340837:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a441666200/0x2deb895b363e6206 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e620d expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.340865:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837816.340881:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837816.340883:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837816.341081:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837816.341122:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837816.341180:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240273664 00000100:00100000:1.0:1788837816.341233:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240273664 00010000:00010000:1.0:1788837816.341276:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a440030a00/0x2deb895b363e62d8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cea3 expref: 10 pid: 5802 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837816.341313:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240273792 00000100:00100000:1.0:1788837816.341317:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240273792 00010000:00010000:1.0:1788837816.341330:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a440031a00/0x2deb895b363e62d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0ce9c expref: 11 pid: 5802 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837816.341350:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:1.0:1788837816.341360:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+11:2351:x1875732240273664:12345-192.168.204.54@tcp:103: 00010000:00010000:1.0:1788837816.341375:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837816.341381:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a440030a00/0x2deb895b363e62d8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cea3 expref: 11 pid: 5802 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.341393:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a440030a00/0x2deb895b363e62d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cea3 expref: 11 pid: 5802 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.341414:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837816.341467:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+11:2351:x1875732240273664:12345-192.168.204.54@tcp:103: Request processed in 107us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837816.341473:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:1.0:1788837816.341504:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:1.0:1788837816.341511:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a409c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:2351:x1875732240273792:12345-192.168.204.54@tcp:103: 00010000:00010000:1.0:1788837816.341518:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837816.341523:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a440031a00/0x2deb895b363e62d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0ce9c expref: 10 pid: 5802 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.341538:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a440031a00/0x2deb895b363e62d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0ce9c expref: 10 pid: 5802 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.341550:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a44a48b000/0x2deb895b363e6310 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.341559:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a44a48b000/0x2deb895b363e6310 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.341575:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a44a48b000/0x2deb895b363e6310 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.341582:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a44a48b000/0x2deb895b363e6310 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.341589:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a44a48b000/0x2deb895b363e6310 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.341596:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a44a48b000/0x2deb895b363e6310 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.341603:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48b000 already unused, calling callback (ffffffffc1616420) 00010000:00010000:1.0:1788837816.341607:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a44a48b000/0x2deb895b363e6310 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.341614:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a44a48b000/0x2deb895b363e6310 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.341623:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a44a48b000/0x2deb895b363e6310 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837816.341643:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837816.341664:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a409c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:2351:x1875732240273792:12345-192.168.204.54@tcp:103: Request processed in 154us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837816.341671:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00010000:00010000:3.0:1788837816.343120:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a440030a00/0x2deb895b363e62d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cea3 expref: 9 pid: 5802 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837816.343140:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1875732254975744:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788837816.343153:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a440031a00/0x2deb895b363e62d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0ce9c expref: 8 pid: 5802 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837816.343164:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4bb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1875732254975872:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788837816.343473:0:8417:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a44a48b000/0x2deb895b363e6310 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837816.343495:0:8417:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97a44a48b000/0x2deb895b363e6310 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837816.343502:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a44a48b000/0x2deb895b363e6310 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837816.343508:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a44a48b000/0x2deb895b363e6310 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837816.869949:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837817.030784:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837817.030846:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837817.031276:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240274048 00000100:00100000:2.0:1788837817.031302:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240274048 00000100:00100000:2.0:1788837817.031395:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:2.0:1788837817.031407:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2352:x1875732240274048:12345-192.168.204.54@tcp:400: 00000100:00100000:2.0:1788837817.031500:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2352:x1875732240274048:12345-192.168.204.54@tcp:400: Request processed in 95us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837817.031507:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:1.0:1788837817.032317:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240274304 00000100:00100000:1.0:1788837817.032331:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240274304 00000100:00100000:1.0:1788837817.032417:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:1.0:1788837817.032428:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2352:x1875732240274304:12345-192.168.204.54@tcp:400: 00000100:00100000:1.0:1788837817.032514:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2352:x1875732240274304:12345-192.168.204.54@tcp:400: Request processed in 88us (1667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837817.032523:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00080000:0.0:1788837817.035028:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788837817.035043:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837817.038346:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837817.038400:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837817.038500:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240273920 00000100:00100000:2.0:1788837817.038513:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240273920 00000100:00100000:2.0:1788837817.038587:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 132 00000100:00100000:2.0:1788837817.038598:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+8:2352:x1875732240273920:12345-192.168.204.54@tcp:400: 00000100:00100000:2.0:1788837817.038711:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+8:2352:x1875732240273920:12345-192.168.204.54@tcp:400: Request processed in 114us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837817.038719:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 132 00000100:00100000:1.0:1788837817.038820:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240274176 00000100:00100000:1.0:1788837817.038825:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240274176 00000100:00100000:1.0:1788837817.038892:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:1.0:1788837817.038900:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2352:x1875732240274176:12345-192.168.204.54@tcp:400: 00000100:00100000:1.0:1788837817.038935:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2352:x1875732240274176:12345-192.168.204.54@tcp:400: Request processed in 36us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837817.038941:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00080000:2.0:1788837817.039020:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:3.0:1788837817.828159:0:5805:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788837817.828170:0:5805:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97a3451f4000 from 39 10000000:01000000:3.0:1788837817.828177:0:5805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788837817.828301:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48b000/0x2deb895b363e6317 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837817.828326:0:5805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a44a48b000/0x2deb895b363e6317 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837817.828342:0:5805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a44a48b000/0x2deb895b363e6317 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837817.828380:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254977792:0@lo:101: 00000100:00100000:3.0:1788837817.828497:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837817.828574:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4590d96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837817.828827:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254977792 00000100:00100000:2.0:1788837817.828838:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254977792 00000100:00100000:2.0:1788837817.828921:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788837817.828933:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+12:5805:x1875732254977792:12345-0@lo:101: 00010000:00010000:2.0:1788837817.828952:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837817.828972:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a441464a00/0x2deb895b363e631e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e6317 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837817.829006:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a441464a00/0x2deb895b363e631e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e6317 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837817.829019:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a441464a00/0x2deb895b363e631e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e6317 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837817.829031:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a441464a00, rc 0) 00000100:00100000:2.0:1788837817.829093:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:5805:x1875732254977792:12345-0@lo:101: Request processed in 163us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837817.829100:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788837817.829279:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254977792:0@lo:101: 00010000:00010000:3.0:1788837817.829300:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a44a48b000/0x2deb895b363e6317 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e631e expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837817.829318:0:5805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a44a48b000/0x2deb895b363e6317 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e631e expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837817.829405:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254977920:0@lo:501: 00000100:00100000:3.0:1788837817.829443:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837817.829583:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4590d96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837817.830837:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254977920 00000100:00100000:0.0:1788837817.830855:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254977920 00000100:00100000:0.0:1788837817.831679:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788837817.831700:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:5805:x1875732254977920:12345-0@lo:501: 00000100:00100000:0.0:1788837817.832172:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:5805:x1875732254977920:12345-0@lo:501: Request processed in 478us (2725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837817.832181:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788837817.832367:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254977920:0@lo:501: 00000100:00100000:3.0:1788837817.832439:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254978048:0@lo:503: 00000100:00100000:3.0:1788837817.832517:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837817.833060:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4590d96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837817.833142:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254978048 00000100:00100000:2.0:1788837817.833152:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254978048 00000100:00100000:2.0:1788837817.833198:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788837817.833412:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:5805:x1875732254978048:12345-0@lo:503: 00000100:00100000:2.0:1788837817.833794:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:5805:x1875732254978048:12345-0@lo:503: Request processed in 385us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837817.833805:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788837817.833977:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254978048:0@lo:503: 00000100:00100000:3.0:1788837817.835031:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8434:1875732254978176:0@lo:502: 00000100:00100000:3.0:1788837817.835113:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837817.835160:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4590d9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788837817.835717:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254978176 00000100:00100000:2.0:1788837817.835728:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254978176 00000100:00100000:2.0:1788837817.835796:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788837817.835806:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a56bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:8434:x1875732254978176:12345-0@lo:502: 00000100:00100000:2.0:1788837817.838441:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a56bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:8434:x1875732254978176:12345-0@lo:502: Request processed in 2621us (3313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837817.838590:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788837817.838830:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8434:1875732254978176:0@lo:502: 00000100:00100000:3.0:1788837817.838922:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8434:1875732254978304:0@lo:502: 00000100:00100000:3.0:1788837817.839006:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837817.839062:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4590d9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788837817.840126:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254978304 00000100:00100000:0.0:1788837817.840144:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254978304 00000100:00100000:0.0:1788837817.840280:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788837817.840294:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:8434:x1875732254978304:12345-0@lo:502: 00000100:00100000:0.0:1788837817.840918:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:8434:x1875732254978304:12345-0@lo:502: Request processed in 624us (1909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837817.840928:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788837817.842366:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8434:1875732254978304:0@lo:502: 00000040:00080000:3.0:1788837817.842444:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788837817.843433:0:5805:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788837817.843479:0:5805:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788837817.843495:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48b000/0x2deb895b363e6317 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e631e expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837817.843508:0:5805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a44a48b000/0x2deb895b363e6317 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e631e expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837817.843520:0:5805:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788837817.843523:0:5805:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788837817.843527:0:5805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788837817.843579:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a46e790600/0x2deb895b363e6325 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837817.843587:0:5805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a46e790600/0x2deb895b363e6325 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837817.843598:0:5805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a46e790600/0x2deb895b363e6325 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837817.843627:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448f92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254978432:0@lo:101: 00000100:00100000:0.0:1788837817.843715:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837817.843785:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f9f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837817.843962:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254978432 00000100:00100000:2.0:1788837817.843973:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254978432 00000100:00100000:2.0:1788837817.844044:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788837817.844056:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a56b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+13:5805:x1875732254978432:12345-0@lo:101: 00010000:00010000:2.0:1788837817.844074:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837817.844096:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a441465600/0x2deb895b363e632c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e6325 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837817.844128:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a441465600/0x2deb895b363e632c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e6325 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837817.844141:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a441465600/0x2deb895b363e632c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e6325 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837817.844152:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a441465600, rc 0) 00000100:00100000:2.0:1788837817.844250:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a56b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:5805:x1875732254978432:12345-0@lo:101: Request processed in 197us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837817.844279:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788837817.844581:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448f92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254978432:0@lo:101: 00010000:00010000:0.0:1788837817.844598:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a46e790600/0x2deb895b363e6325 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e632c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837817.844610:0:5805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a46e790600/0x2deb895b363e6325 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e632c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837817.844685:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448f92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254978560:0@lo:501: 00000100:00100000:0.0:1788837817.844718:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837817.844796:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f9f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837817.849155:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254978560 00000100:00100000:2.0:1788837817.849183:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254978560 00000100:00100000:2.0:1788837817.849651:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788837817.849667:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:5805:x1875732254978560:12345-0@lo:501: 00000100:00100000:2.0:1788837817.850267:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:5805:x1875732254978560:12345-0@lo:501: Request processed in 601us (5545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837817.850289:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788837817.851850:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448f92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254978560:0@lo:501: 00000100:00100000:3.0:1788837817.851954:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254978688:0@lo:503: 00000100:00100000:3.0:1788837817.852137:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837817.852608:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4590d9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788837817.852735:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254978688 00000100:00100000:1.0:1788837817.852745:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254978688 00000100:00100000:1.0:1788837817.852820:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788837817.852832:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:5805:x1875732254978688:12345-0@lo:503: 00000100:00100000:1.0:1788837817.853946:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:5805:x1875732254978688:12345-0@lo:503: Request processed in 1109us (1801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837817.853962:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788837817.854085:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254978688:0@lo:503: 00000100:00100000:2.0:1788837817.855076:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a408700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8435:1875732254978816:0@lo:502: 00000100:00100000:2.0:1788837817.855162:0:8435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837817.855633:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448e43540 going to sleep for 11 seconds 00000100:00100000:0.0:1788837817.855735:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254978816 00000100:00100000:0.0:1788837817.855745:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254978816 00000100:00100000:0.0:1788837817.855854:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788837817.855867:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:8435:x1875732254978816:12345-0@lo:502: 00000100:00100000:0.0:1788837817.856192:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:8435:x1875732254978816:12345-0@lo:502: Request processed in 326us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837817.856642:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788837817.856801:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a408700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8435:1875732254978816:0@lo:502: 00000020:01000000:3.0:1788837817.856864:0:8435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788837817.856880:0:8435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837817.856883:0:8435:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788837817.856891:0:8435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788837817.856939:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8435:1875732254978944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837817.857006:0:8435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837817.865158:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254978944 00000100:00100000:2.0:1788837817.865185:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254978944 00000100:00100000:2.0:1788837817.865310:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788837817.865328:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:8435:x1875732254978944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837817.865709:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:8435:x1875732254978944:12345-0@lo:502:llog_process_th.0 Request processed in 386us (8701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837817.865718:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788837817.867078:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4590d96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837817.867129:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8435:1875732254978944:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788837817.867190:0:8435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837817.867217:0:8435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837817.867602:0:8435:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788837817.867665:0:8435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788837817.867928:0:5805:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788837817.867961:0:5805:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788837817.867977:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a46e790600/0x2deb895b363e6325 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e632c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837817.867990:0:5805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a46e790600/0x2deb895b363e6325 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e632c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837817.868003:0:5805:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788837817.868006:0:5805:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97a448f86800 from 39 10000000:01000000:0.0:1788837817.868010:0:5805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788837817.868058:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a46e790a00/0x2deb895b363e6333 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837817.868081:0:5805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a46e790a00/0x2deb895b363e6333 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837817.868094:0:5805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a46e790a00/0x2deb895b363e6333 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837817.868124:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448f92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254979072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788837817.868819:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837817.868983:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f9f240 going to sleep for 11 seconds 00000100:00100000:2.0:1788837817.869023:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254979072 00000100:00100000:2.0:1788837817.869033:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254979072 00000100:00100000:2.0:1788837817.869133:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788837817.869145:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:5805:x1875732254979072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837817.869164:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837817.869183:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a441464000/0x2deb895b363e633a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e6333 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837817.869542:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a441464000/0x2deb895b363e633a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e6333 expref: 15 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837817.869556:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a441464000/0x2deb895b363e633a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e6333 expref: 15 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837817.869567:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a441464000, rc 0) 00000100:00100000:2.0:1788837817.869808:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:5805:x1875732254979072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 665us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837817.869817:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788837817.869931:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448f92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254979072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837817.869951:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a46e790a00/0x2deb895b363e6333 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e633a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837817.869963:0:5805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a46e790a00/0x2deb895b363e6333 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e633a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837817.870058:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254979200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837817.870102:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837817.870141:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448ffe900 going to sleep for 11 seconds 00000100:00100000:0.0:1788837817.870390:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254979200 00000100:00100000:0.0:1788837817.870398:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254979200 00000100:00100000:1.0:1788837817.870611:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788837817.870631:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:5805:x1875732254979200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837817.871003:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:5805:x1875732254979200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 373us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837817.871012:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788837817.871095:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254979200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837817.871148:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254979328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837817.871246:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837817.871852:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4590d96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837817.871941:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254979328 00000100:00100000:2.0:1788837817.871951:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254979328 00000100:00100000:2.0:1788837817.872000:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788837817.872010:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:5805:x1875732254979328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837817.872288:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:5805:x1875732254979328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 278us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837817.872296:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788837817.872450:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254979328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837817.873089:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8436:1875732254979456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837817.873149:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837817.873189:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4590d9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788837817.873414:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254979456 00000100:00100000:2.0:1788837817.873421:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254979456 00000100:00100000:2.0:1788837817.873469:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788837817.873479:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:8436:x1875732254979456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837817.873868:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:8436:x1875732254979456:12345-0@lo:502:llog_process_th.0 Request processed in 390us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837817.873877:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788837817.874015:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8436:1875732254979456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837817.874084:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8436:1875732254979584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837817.874127:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837817.874161:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4590d9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788837817.874239:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254979584 00000100:00100000:2.0:1788837817.874245:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254979584 00000100:00100000:2.0:1788837817.874289:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788837817.874297:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:8436:x1875732254979584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837817.874449:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:8436:x1875732254979584:12345-0@lo:502:llog_process_th.0 Request processed in 153us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837817.877810:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8436:1875732254979584:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788837817.877898:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:2.0:1788837817.878174:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000020:01000000:2.0:1788837817.878249:0:5805:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788837817.878287:0:5805:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788837817.878302:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a46e790a00/0x2deb895b363e6333 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e633a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837817.878315:0:5805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a46e790a00/0x2deb895b363e6333 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e633a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837817.878328:0:5805:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788837817.878332:0:5805:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788837817.878335:0:5805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788837817.878392:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6341 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837817.878402:0:5805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6341 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837817.878412:0:5805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6341 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837817.878439:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254979712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788837817.878595:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837817.878639:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448e43540 going to sleep for 11 seconds 00000100:00100000:2.0:1788837817.878670:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254979712 00000100:00100000:2.0:1788837817.878692:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254979712 00000100:00100000:2.0:1788837817.878735:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788837817.878745:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:5805:x1875732254979712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837817.878762:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837817.878779:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a441464c00/0x2deb895b363e6348 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e6341 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837817.878809:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a441464c00/0x2deb895b363e6348 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e6341 expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837817.878821:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a441464c00/0x2deb895b363e6348 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e6341 expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837817.878831:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a441464c00, rc 0) 00000100:00100000:2.0:1788837817.878882:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:5805:x1875732254979712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837817.878888:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788837817.879422:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254979712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837817.879443:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6341 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6348 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837817.879479:0:5805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6341 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e6348 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837817.879555:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254979840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837817.879599:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837817.879629:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4590d9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788837817.880484:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254979840 00000100:00100000:1.0:1788837817.880496:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254979840 00000100:00100000:1.0:1788837817.880563:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788837817.880574:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:5805:x1875732254979840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837817.882149:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:5805:x1875732254979840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1568us (2540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837817.882164:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788837817.882479:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254979840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837817.882555:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254979968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837817.882732:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837817.882768:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4590d9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788837817.882978:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254979968 00000100:00100000:2.0:1788837817.882988:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254979968 00000100:00100000:2.0:1788837817.883053:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788837817.883063:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:5805:x1875732254979968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837817.883345:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:5805:x1875732254979968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 283us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837817.883353:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788837817.883431:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254979968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837817.884351:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448f90a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8437:1875732254980096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837817.884426:0:8437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837817.884594:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f9f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837817.884644:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254980096 00000100:00100000:1.0:1788837817.884655:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254980096 00000100:00100000:1.0:1788837817.884745:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788837817.884755:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:8437:x1875732254980096:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837817.885062:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:8437:x1875732254980096:12345-0@lo:502:llog_process_th.0 Request processed in 308us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837817.885071:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788837817.885182:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448f90a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8437:1875732254980096:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788837817.885441:0:8437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837817.885527:0:8437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837817.885531:0:8437:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788837817.885545:0:8437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788837817.885581:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8437:1875732254980224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837817.885632:0:8437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837817.885721:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a447c8ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788837817.885987:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254980224 00000100:00100000:1.0:1788837817.885994:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254980224 00000100:00100000:1.0:1788837817.886042:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788837817.886051:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:8437:x1875732254980224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837817.886483:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:8437:x1875732254980224:12345-0@lo:502:llog_process_th.0 Request processed in 432us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837817.886494:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788837817.886727:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8437:1875732254980224:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788837817.886762:0:8437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837817.886769:0:8437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837817.886771:0:8437:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788837817.886776:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1788837817.887074:0:5805:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1788837817.887112:0:5805:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788837817.887126:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6341 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6348 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837817.887138:0:5805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6341 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6348 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837817.887151:0:5805:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788837817.887155:0:5805:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97a448c63800 from 39 10000000:01000000:1.0:1788837817.887158:0:5805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788837817.887197:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a458d3cc00/0x2deb895b363e634f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837817.887237:0:5805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a458d3cc00/0x2deb895b363e634f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837817.887250:0:5805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a458d3cc00/0x2deb895b363e634f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837817.887295:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254980352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788837817.887350:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837817.887396:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448ffed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837817.887585:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254980352 00000100:00100000:0.0:1788837817.887593:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254980352 00000100:00100000:0.0:1788837817.887641:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788837817.887652:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:5805:x1875732254980352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837817.887667:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837817.887685:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a46e791800/0x2deb895b363e6356 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e634f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837817.887719:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a46e791800/0x2deb895b363e6356 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e634f expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837817.887730:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a46e791800/0x2deb895b363e6356 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e634f expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837817.887753:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e791800, rc 0) 00000100:00100000:0.0:1788837817.887802:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:5805:x1875732254980352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837817.887810:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788837817.887928:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254980352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837817.887947:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a458d3cc00/0x2deb895b363e634f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6356 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837817.887957:0:5805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a458d3cc00/0x2deb895b363e634f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e6356 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837817.888023:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254980480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837817.888054:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837817.888084:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448ffed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837817.888139:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254980480 00000100:00100000:0.0:1788837817.888144:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254980480 00000100:00100000:0.0:1788837817.888177:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788837817.888185:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:5805:x1875732254980480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837817.888741:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:5805:x1875732254980480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 554us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837817.888751:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788837817.888830:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254980480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837817.888877:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254980608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837817.888940:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837817.888970:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4619e3300 going to sleep for 11 seconds 00000100:00100000:1.0:1788837817.889040:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254980608 00000100:00100000:1.0:1788837817.889046:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254980608 00000100:00100000:1.0:1788837817.889095:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788837817.889105:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a523050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:5805:x1875732254980608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837817.889337:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a523050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:5805:x1875732254980608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 233us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837817.889345:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788837817.889446:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254980608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837817.891813:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448f93480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8438:1875732254980736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837817.891922:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837817.892374:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f9f300 going to sleep for 11 seconds 00010000:00010000:3.0:1788837817.901658:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837817.909304:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254980736 00000100:00100000:2.0:1788837817.909332:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254980736 00000100:00100000:2.0:1788837817.909685:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788837817.909700:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:8438:x1875732254980736:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837817.910186:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:8438:x1875732254980736:12345-0@lo:502:llog_process_th.0 Request processed in 487us (18260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837817.910197:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788837817.910400:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448f93480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8438:1875732254980736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837817.910506:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8438:1875732254980864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837817.910599:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837817.911173:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448ffe240 going to sleep for 11 seconds 00000100:00100000:2.0:1788837817.911465:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254980864 00000100:00100000:2.0:1788837817.911474:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254980864 00000100:00100000:2.0:1788837817.911535:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788837817.911546:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a520450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:8438:x1875732254980864:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837817.912634:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a520450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:8438:x1875732254980864:12345-0@lo:502:llog_process_th.0 Request processed in 1083us (2035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837817.912658:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788837817.913366:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8438:1875732254980864:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788837817.913423:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788837817.913952:0:5805:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788837817.913986:0:5805:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788837817.914003:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a458d3cc00/0x2deb895b363e634f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6356 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837817.914016:0:5805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a458d3cc00/0x2deb895b363e634f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6356 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837817.914029:0:5805:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788837817.914032:0:5805:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788837817.914036:0:5805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788837817.914093:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441464400/0x2deb895b363e635d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837817.914103:0:5805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a441464400/0x2deb895b363e635d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837817.914115:0:5805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a441464400/0x2deb895b363e635d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837817.914147:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254980992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788837817.914394:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837817.914567:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a449e7d600 going to sleep for 11 seconds 00000100:00100000:1.0:1788837817.914612:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254980992 00000100:00100000:1.0:1788837817.914622:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254980992 00000100:00100000:1.0:1788837817.914731:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788837817.914743:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a520c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:5805:x1875732254980992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837817.914762:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837817.914781:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a458d3da00/0x2deb895b363e6364 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e635d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837817.914817:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a458d3da00/0x2deb895b363e6364 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e635d expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837817.914829:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a458d3da00/0x2deb895b363e6364 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e635d expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837817.914839:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3da00, rc 0) 00000100:00100000:1.0:1788837817.914893:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a520c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:5805:x1875732254980992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837817.914900:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788837817.914981:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254980992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837817.914998:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a441464400/0x2deb895b363e635d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6364 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837817.915026:0:5805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a441464400/0x2deb895b363e635d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e6364 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837817.915113:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254981120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837817.915148:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837817.915531:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a449e7d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788837817.915695:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254981120 00000100:00100000:0.0:1788837817.915703:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254981120 00000100:00100000:0.0:1788837817.915742:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788837817.915751:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a521850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:5805:x1875732254981120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837817.916127:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a521850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:5805:x1875732254981120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 377us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837817.916136:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788837817.916283:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254981120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837817.916334:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254981248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837817.916386:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837817.916413:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a449e7d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788837817.916476:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254981248 00000100:00100000:0.0:1788837817.916481:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254981248 00000100:00100000:0.0:1788837817.916507:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788837817.916513:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a522c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:5805:x1875732254981248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837817.916698:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a522c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:5805:x1875732254981248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 183us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837817.916705:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788837817.916845:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254981248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837817.917365:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8439:1875732254981376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837817.917417:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837817.917447:0:8439:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a449e7d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788837817.917556:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254981376 00000100:00100000:0.0:1788837817.917564:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254981376 00000100:00100000:0.0:1788837817.917597:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788837817.917605:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:8439:x1875732254981376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837817.917833:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:8439:x1875732254981376:12345-0@lo:502:llog_process_th.0 Request processed in 228us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837817.917841:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788837817.917936:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8439:1875732254981376:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788837817.917972:0:8439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837817.917985:0:8439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837817.917989:0:8439:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788837817.917996:0:8439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788837817.918022:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8439:1875732254981504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837817.918058:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837817.918080:0:8439:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a449e7d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788837817.918131:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254981504 00000100:00100000:0.0:1788837817.918137:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254981504 00000100:00100000:0.0:1788837817.918158:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788837817.918164:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:8439:x1875732254981504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837817.918359:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:8439:x1875732254981504:12345-0@lo:502:llog_process_th.0 Request processed in 194us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837817.918366:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788837817.918607:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8439:1875732254981504:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788837817.918638:0:8439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837817.918643:0:8439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837817.918645:0:8439:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788837817.918649:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788837817.918847:0:5805:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788837817.918869:0:5805:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788837817.918884:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441464400/0x2deb895b363e635d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6364 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837817.918896:0:5805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a441464400/0x2deb895b363e635d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6364 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837817.918910:0:5805:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788837817.918913:0:5805:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97a448f399b8 from 1 10000000:01000000:0.0:1788837817.918923:0:5805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788837817.918959:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a46e790400/0x2deb895b363e636b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837817.918968:0:5805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a46e790400/0x2deb895b363e636b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837817.918979:0:5805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a46e790400/0x2deb895b363e636b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837817.919001:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448f91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254981632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788837817.919043:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837817.919080:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a449a34c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788837817.919134:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254981632 00000100:00100000:2.0:1788837817.919140:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254981632 00000100:00100000:2.0:1788837817.919169:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788837817.919178:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:5805:x1875732254981632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837817.919189:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837817.919296:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a441465800/0x2deb895b363e6372 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e636b expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837817.919352:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a441465800/0x2deb895b363e6372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e636b expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837817.919363:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a441465800/0x2deb895b363e6372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e636b expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837817.919372:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a441465800, rc 0) 00000100:00100000:2.0:1788837817.919408:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:5805:x1875732254981632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 231us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837817.919415:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788837817.919636:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448f91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254981632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837817.919651:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a46e790400/0x2deb895b363e636b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6372 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837817.919662:0:5805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a46e790400/0x2deb895b363e636b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e6372 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837817.919721:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448f91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254981760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837817.919753:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837817.919782:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a449a34c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788837817.919795:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254981760 00000100:00100000:0.0:1788837817.919799:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254981760 00000100:00100000:0.0:1788837817.919821:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788837817.919827:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:5805:x1875732254981760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837817.920107:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:5805:x1875732254981760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 278us (352us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788837817.920124:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788837817.920254:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448f91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254981760:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788837817.920290:0:5805:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788837817.920296:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a46e790400/0x2deb895b363e636b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6372 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837817.920305:0:5805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a46e790400/0x2deb895b363e636b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6372 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837818.018790:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837818.018826:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448f90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254981888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837818.018931:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837818.019080:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254981888 00000100:00100000:0.0:1788837818.019092:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254981888 00000100:00100000:0.0:1788837818.019188:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788837818.019243:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254981888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788837818.019303:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837818.019363:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254981888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837818.019371:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788837818.019401:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788837818.020041:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a448f90380 x1875732254981888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837818.020078:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448f90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254981888:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788837818.916948:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837819.555258:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788837819.555295:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448f90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254982016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837819.555400:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837819.556073:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254982016 00000100:00100000:0.0:1788837819.556086:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254982016 00000100:00100000:0.0:1788837819.556187:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788837819.556228:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732254982016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788837819.556291:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837819.556363:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732254982016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 165us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837819.556378:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788837819.556449:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a448f90380 x1875732254982016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837835 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837819.556472:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448f90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254982016:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788837819.556864:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837819.557004:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837819.557105:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3274:1875732254982400:0@lo:400:kworker.0 00000100:00100000:2.0:1788837819.557184:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837819.557254:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837819.557260:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3274:1875732254982272:0@lo:400:kworker.0 00000100:00100000:2.0:1788837819.557286:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837819.557323:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254982400 00000100:00100000:2.0:1788837819.557330:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254982400 00000100:00100000:2.0:1788837819.557379:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254982272 00000100:00100000:2.0:1788837819.557382:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254982272 00000100:00100000:2.0:1788837819.557406:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788837819.557414:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1875732254982400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837819.557482:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1875732254982400:12345-0@lo:400:kworker.0 Request processed in 69us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837819.557490:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788837819.557505:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788837819.557512:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1875732254982272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837819.557538:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1875732254982272:12345-0@lo:400:kworker.0 Request processed in 28us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837819.557545:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788837819.557584:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837819.557612:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3274:1875732254982272:0@lo:400:kworker.0 00000100:00100000:2.0:1788837819.557626:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3274:1875732254982400:0@lo:400:kworker.0 00000100:00100000:0.0:1788837819.558106:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788837819.558133:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254982528:0@lo:400:kworker.0 00000100:00100000:0.0:1788837819.558182:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837819.558715:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254982528 00000100:00100000:2.0:1788837819.558724:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254982528 00000100:00100000:2.0:1788837819.558786:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788837819.558797:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732254982528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837819.558855:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732254982528:12345-0@lo:400:kworker.0 Request processed in 60us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837819.558871:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788837819.559466:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a450ad1500 x1875732254982528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837819.559484:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254982528:0@lo:400:kworker.0 00000100:00100000:3.0:1788837819.559843:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732254982144:0@lo:400:kworker.0 00000100:00100000:3.0:1788837819.559910:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837819.560006:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254982144 00000100:00100000:0.0:1788837819.560013:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254982144 00000100:00100000:0.0:1788837819.560110:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788837819.560121:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a521c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3271:x1875732254982144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837819.560179:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a521c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3271:x1875732254982144:12345-0@lo:400:kworker.0 Request processed in 60us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837819.560188:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788837819.560293:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732254982144:0@lo:400:kworker.0 00000100:00100000:1.0:1788837819.560470:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3272:1875732254982656:0@lo:400:kworker.0 00000100:00100000:1.0:1788837819.560509:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837819.560862:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254982656 00000100:00100000:3.0:1788837819.560869:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254982656 00000100:00100000:3.0:1788837819.560932:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788837819.560940:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3272:x1875732254982656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837819.560990:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3272:x1875732254982656:12345-0@lo:400:kworker.0 Request processed in 51us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837819.560997:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788837819.561073:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837819.561102:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3272:1875732254982656:0@lo:400:kworker.0 00010000:00010000:1.0:1788837819.940751:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837820.963468:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837821.987536:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837822.150862:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837822.150918:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837822.150963:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837822.150999:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837822.151091:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240274816 00000100:00100000:1.0:1788837822.151105:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240274816 00000100:00100000:1.0:1788837822.151197:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240274688 00000100:00100000:1.0:1788837822.151234:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240274688 00000100:00100000:1.0:1788837822.151272:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:1.0:1788837822.151285:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2352:x1875732240274816:12345-192.168.204.54@tcp:400: 00000100:00100000:1.0:1788837822.151391:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2352:x1875732240274816:12345-192.168.204.54@tcp:400: Request processed in 108us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837822.151399:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:1.0:1788837822.151419:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:1.0:1788837822.151426:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2352:x1875732240274688:12345-192.168.204.54@tcp:400: 00000100:00100000:1.0:1788837822.151455:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2352:x1875732240274688:12345-192.168.204.54@tcp:400: Request processed in 29us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837822.151460:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00080000:2.0:1788837822.151983:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788837822.151990:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837822.152251:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240274432 00000100:00100000:3.0:1788837822.152281:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240274432 00000100:00100000:3.0:1788837822.152339:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 166 00000100:00100000:3.0:1788837822.152349:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a520850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+8:2352:x1875732240274432:12345-192.168.204.54@tcp:400: 00000100:00100000:3.0:1788837822.152423:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a520850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+8:2352:x1875732240274432:12345-192.168.204.54@tcp:400: Request processed in 76us (1459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837822.152432:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 166 00000100:00100000:0.0:1788837822.152881:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240274560 00000100:00100000:0.0:1788837822.152888:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240274560 00000100:00100000:0.0:1788837822.152954:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:0.0:1788837822.152965:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2352:x1875732240274560:12345-192.168.204.54@tcp:400: 00000100:00100000:0.0:1788837822.153011:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2352:x1875732240274560:12345-192.168.204.54@tcp:400: Request processed in 50us (2167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837822.153019:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00080000:3.0:1788837822.153809:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837822.663918:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837822.664045:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240274944 00000100:00100000:0.0:1788837822.664060:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240274944 00000100:00100000:0.0:1788837822.664312:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 167 00000100:00100000:0.0:1788837822.664326:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a522850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+8:5591:x1875732240274944:12345-192.168.204.54@tcp:101: 00010000:00010000:0.0:1788837822.664348:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837822.664370:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a46e790e00/0x2deb895b363e6379 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0cf05 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837822.664446:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a46e790e00/0x2deb895b363e6379 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf05 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837822.664460:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a46e790e00/0x2deb895b363e6379 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf05 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837822.664478:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e790e00, rc 0) 00000100:00100000:0.0:1788837822.664555:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a522850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+9:5591:x1875732240274944:12345-192.168.204.54@tcp:101: Request processed in 233us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837822.664563:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 167 00000100:00100000:1.0:1788837822.667311:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837822.667541:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240275072 00000100:00100000:2.0:1788837822.667557:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240275072 00000100:00100000:2.0:1788837822.667778:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 168 00000100:00100000:2.0:1788837822.667791:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+9:5591:x1875732240275072:12345-192.168.204.54@tcp:501: 00000100:00100000:2.0:1788837822.668276:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+9:5591:x1875732240275072:12345-192.168.204.54@tcp:501: Request processed in 485us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837822.668287:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 168 00000100:00100000:1.0:1788837822.676129:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837822.678118:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240275200 00000100:00100000:0.0:1788837822.678141:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240275200 00000100:00100000:0.0:1788837822.678340:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 169 00000100:00100000:0.0:1788837822.678354:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a523c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+9:5591:x1875732240275200:12345-192.168.204.54@tcp:503: 00000100:00100000:0.0:1788837822.678952:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a523c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+9:5591:x1875732240275200:12345-192.168.204.54@tcp:503: Request processed in 491us (2729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837822.678963:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 169 00000100:00100000:0.0:1788837822.685635:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837822.689564:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240275328 00000100:00100000:2.0:1788837822.689587:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240275328 00000100:00100000:2.0:1788837822.689705:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 170 00000100:00100000:2.0:1788837822.689717:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+9:6088:x1875732240275328:12345-192.168.204.54@tcp:502: 00000100:00100000:2.0:1788837822.690134:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+9:6088:x1875732240275328:12345-192.168.204.54@tcp:502: Request processed in 417us (4520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837822.690144:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 170 00000100:00100000:1.0:1788837822.696800:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837822.696978:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240275456 00000100:00100000:3.0:1788837822.696991:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240275456 00000100:00100000:3.0:1788837822.697120:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 171 00000100:00100000:3.0:1788837822.697132:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+9:6088:x1875732240275456:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788837822.697584:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+9:6088:x1875732240275456:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 453us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837822.697594:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 171 00000100:00100000:1.0:1788837822.706343:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837822.707252:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240275584 00000100:00100000:2.0:1788837822.707268:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240275584 00000100:00100000:2.0:1788837822.707348:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 172 00000100:00100000:2.0:1788837822.707369:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+9:5591:x1875732240275584:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837822.707415:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837822.707442:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a441465a00/0x2deb895b363e6380 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0cf0c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837822.707485:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a441465a00/0x2deb895b363e6380 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf0c expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837822.707499:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a441465a00/0x2deb895b363e6380 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf0c expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837822.707521:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a441465a00, rc 0) 00000100:00100000:2.0:1788837822.707729:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:5591:x1875732240275584:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 370us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837822.707737:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 172 00000100:00100000:2.0:1788837822.714486:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837822.714733:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240275712 00000100:00100000:3.0:1788837822.714748:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240275712 00000100:00100000:3.0:1788837822.716013:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 173 00000100:00100000:3.0:1788837822.716037:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:5591:x1875732240275712:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837822.717031:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:5591:x1875732240275712:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 996us (2553us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788837822.717048:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 173 00010000:00010000:2.0:1788837823.011189:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837823.138646:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837823.138682:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448f92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254982784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837823.138786:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837823.139139:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254982784 00000100:00100000:0.0:1788837823.139151:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254982784 00000100:00100000:0.0:1788837823.139272:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788837823.139286:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254982784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788837823.139343:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837823.139411:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254982784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837823.139419:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788837823.139648:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788837823.139741:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a448f92680 x1875732254982784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837823.139766:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448f92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254982784:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1788837823.980127:0:8477:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffefd648c90 20000000:00000080:1.0:1788837823.980164:0:8477:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97a449427000 uarg=0000000000000000 20000000:01000000:1.0:1788837823.980244:0:8477:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788837823.980252:0:8477:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788837823.980258:0:8477:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788837823.981797:0:8478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788837823.982019:0:8477:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1788837823.987016:0:8477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1788837823.987086:0:8477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1788837823.987145:0:8477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1788837823.987179:0:8477:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788837823.987828:0:8477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a458d3c600/0x2deb895b363e6387 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837823.987854:0:8477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a440031800/0x2deb895b363e60fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e60f5 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837823.987863:0:8477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a441520e00/0x2deb895b363e615e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e6157 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837823.987870:0:8477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a440030c00/0x2deb895b363e6229 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e6222 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837823.987896:0:8477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a441464600/0x2deb895b363e62e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0ced4 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837823.987905:0:8477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a458d3c600/0x2deb895b363e6387 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837823.987961:0:8477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a441464600/0x2deb895b363e62e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0ced4 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837823.987982:0:8477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a441464600/0x2deb895b363e62e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0ced4 expref: 9 pid: 5802 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837823.988000:0:8477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8477:1875732254982912:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788837823.988197:0:8477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a440030c00/0x2deb895b363e6229 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e6222 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837823.988236:0:8477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a440030c00/0x2deb895b363e6229 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e6222 expref: 18 pid: 5803 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837823.988248:0:8477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8477:1875732254983040:0@lo:104: 00000100:00100000:1.0:1788837823.988313:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788837823.988370:0:8477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a441520e00/0x2deb895b363e615e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e6157 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837823.988379:0:8477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a441520e00/0x2deb895b363e615e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e6157 expref: 18 pid: 5803 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837823.988388:0:8477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8477:1875732254983168:0@lo:104: 00000100:00100000:1.0:1788837823.988426:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788837823.988452:0:8477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a440031800/0x2deb895b363e60fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e60f5 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837823.988460:0:8477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a440031800/0x2deb895b363e60fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e60f5 expref: 18 pid: 5800 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837823.988469:0:8477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8477:1875732254983296:0@lo:104: 00000100:00100000:1.0:1788837823.988490:0:8477:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a44a3143c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837823.988643:0:5792:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788837823.988668:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837823.988682:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254983040 00000100:00100000:2.0:1788837823.988690:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254983040 00000100:00100000:2.0:1788837823.988793:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254983168 00000100:00100000:2.0:1788837823.988797:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254983168 00000100:00100000:2.0:1788837823.988809:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254983296 00000100:00100000:2.0:1788837823.988812:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254983296 00000100:00100000:2.0:1788837823.988826:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788837823.988836:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+5:8477:x1875732254983040:12345-0@lo:104: 00010000:00010000:2.0:1788837823.988852:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a441666e00/0x2deb895b363e6222 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e6229 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837823.988946:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788837823.988954:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+5:8477:x1875732254983040:12345-0@lo:104: Request processed in 119us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837823.988961:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788837823.988981:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788837823.988988:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e731850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+4:8477:x1875732254983168:12345-0@lo:104: 00010000:00010000:2.0:1788837823.988996:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a441666800/0x2deb895b363e6157 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e615e expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837823.989033:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788837823.989039:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e731850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+4:8477:x1875732254983168:12345-0@lo:104: Request processed in 53us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837823.989045:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788837823.989083:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788837823.989090:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a408700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+3:8477:x1875732254983296:12345-0@lo:104: 00010000:00010000:2.0:1788837823.989098:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a441667400/0x2deb895b363e60f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e60fc expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837823.989129:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788837823.989134:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a408700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+3:8477:x1875732254983296:12345-0@lo:104: Request processed in 45us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837823.989140:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788837823.989171:0:7597:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788837823.989179:0:7597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a441666e00/0x2deb895b363e6222 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e6229 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837823.989186:0:7597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441666e00 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:2.0:1788837823.989197:0:7597:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a441666e00/0x2deb895b363e6222 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e6229 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837823.989235:0:7597:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a441666e00/0x2deb895b363e6222 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e6229 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837823.989244:0:7597:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a441666e00/0x2deb895b363e6222 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e6229 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837823.989250:0:7597:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788837823.989283:0:7597:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a441666e00/0x2deb895b363e6222 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e6229 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837823.989290:0:7597:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788837823.989315:0:7597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a441666e00/0x2deb895b363e6222 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e6229 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837823.989323:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a441666e00/0x2deb895b363e6222 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e6229 expref: -99 pid: 7591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837823.989350:0:7597:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788837823.989354:0:7597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a441666800/0x2deb895b363e6157 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e615e expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837823.989360:0:7597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441666800 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:2.0:1788837823.989363:0:7597:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a441666800/0x2deb895b363e6157 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e615e expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837823.989370:0:7597:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a441666800/0x2deb895b363e6157 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e615e expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837823.989388:0:7597:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a441666800/0x2deb895b363e6157 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e615e expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837823.989394:0:7597:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788837823.989408:0:7597:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a441666800/0x2deb895b363e6157 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e615e expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837823.989414:0:7597:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788837823.989431:0:7597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a441666800/0x2deb895b363e6157 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e615e expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837823.989439:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a441666800/0x2deb895b363e6157 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e615e expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837823.989449:0:7597:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837823.989452:0:7597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a441667400/0x2deb895b363e60f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e60fc expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837823.989458:0:7597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441667400 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:2.0:1788837823.989461:0:7597:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a441667400/0x2deb895b363e60f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e60fc expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837823.989467:0:7597:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a441667400/0x2deb895b363e60f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e60fc expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837823.989474:0:7597:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a441667400/0x2deb895b363e60f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e60fc expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837823.989480:0:7597:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788837823.989500:0:7597:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a441667400/0x2deb895b363e60f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e60fc expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837823.989506:0:7597:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788837823.989513:0:7597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a441667400/0x2deb895b363e60f5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e60fc expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837823.989519:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a441667400/0x2deb895b363e60f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e60fc expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837823.989534:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837823.989536:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837823.989538:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837823.989554:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3274:1875732254983424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837823.989593:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837823.989647:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732254983680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837823.989670:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837823.989688:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788837823.989694:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732254983552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837823.989714:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837823.989745:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254983424 00000100:00100000:2.0:1788837823.989751:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254983424 00010000:00010000:2.0:1788837823.989774:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a440030c00/0x2deb895b363e6229 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e6222 expref: 19 pid: 5803 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837823.989798:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254983680 00000100:00100000:2.0:1788837823.989801:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254983680 00010000:00010000:2.0:1788837823.989812:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a440031800/0x2deb895b363e60fc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e60f5 expref: 20 pid: 5800 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837823.989836:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254983552 00000100:00100000:2.0:1788837823.989839:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254983552 00010000:00010000:2.0:1788837823.989850:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a441520e00/0x2deb895b363e615e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e6157 expref: 21 pid: 5803 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837823.989862:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788837823.989868:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+21:3274:x1875732254983424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788837823.989880:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837823.989886:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a440030c00/0x2deb895b363e6229 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e6222 expref: 21 pid: 5803 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837823.989896:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a440030c00/0x2deb895b363e6229 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e6222 expref: 21 pid: 5803 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837823.989916:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837823.989947:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+21:3274:x1875732254983424:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837823.989954:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788837823.989969:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788837823.989975:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a409880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+20:3272:x1875732254983680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788837823.989983:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837823.989987:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a440031800/0x2deb895b363e60fc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e60f5 expref: 20 pid: 5800 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837823.989996:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a440031800/0x2deb895b363e60fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e60f5 expref: 20 pid: 5800 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837823.990006:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837823.990038:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a409880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+20:3272:x1875732254983680:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837823.990044:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788837823.990055:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788837823.990060:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3272:x1875732254983552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788837823.990066:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837823.990070:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a441520e00/0x2deb895b363e615e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e6157 expref: 19 pid: 5803 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837823.990077:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a441520e00/0x2deb895b363e615e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e6157 expref: 19 pid: 5803 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837823.990086:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837823.990104:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3272:x1875732254983552:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837823.990109:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788837823.990145:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732254983552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837823.990166:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732254983680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837823.990195:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3274:1875732254983424:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788837823.990503:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837823.990846:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a440030c00/0x2deb895b363e6229 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e6222 expref: 18 pid: 5803 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837823.990862:0:8477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8477:1875732254983040:0@lo:104: 00010000:00010000:1.0:1788837823.990873:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a441520e00/0x2deb895b363e615e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e6157 expref: 17 pid: 5803 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837823.990884:0:8477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8477:1875732254983168:0@lo:104: 00010000:00010000:1.0:1788837823.990894:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a440031800/0x2deb895b363e60fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e60f5 expref: 16 pid: 5800 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837823.990903:0:8477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8477:1875732254983296:0@lo:104: 00010000:00010000:1.0:1788837823.991467:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837823.994820:0:8477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8477:1875732254982912:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788837823.994878:0:8477:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a458d3c600/0x2deb895b363e6387 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837823.994945:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837823.995014:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240275840 00000100:00100000:1.0:1788837823.995024:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240275840 00010000:00010000:1.0:1788837823.995068:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a441464600/0x2deb895b363e62e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0ced4 expref: 10 pid: 5802 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837823.995131:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:1.0:1788837823.995142:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:2351:x1875732240275840:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837823.995173:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837823.995181:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a441464600/0x2deb895b363e62e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0ced4 expref: 10 pid: 5802 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837823.995243:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a441464600/0x2deb895b363e62e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0ced4 expref: 10 pid: 5802 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837823.995268:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a441464600/0x2deb895b363e62e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0ced4 expref: 10 pid: 5802 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837823.995292:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a458d3c600/0x2deb895b363e6387 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837823.995302:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a458d3c600/0x2deb895b363e6387 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837823.995320:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a458d3c600/0x2deb895b363e6387 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837823.995328:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a458d3c600/0x2deb895b363e6387 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837823.995345:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a458d3c600/0x2deb895b363e6387 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837823.995354:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a458d3c600/0x2deb895b363e6387 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837823.995372:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3c600 already unused, calling callback (ffffffffc1616420) 00010000:00010000:1.0:1788837823.995378:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a458d3c600/0x2deb895b363e6387 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837823.995387:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a458d3c600/0x2deb895b363e6387 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837823.995414:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a458d3c600/0x2deb895b363e6387 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837823.995425:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837823.995495:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+9:2351:x1875732240275840:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 354us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837823.995504:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00010000:00010000:0.0:1788837823.995887:0:8477:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97a458d3c600/0x2deb895b363e6387 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837823.995898:0:8477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a458d3c600/0x2deb895b363e6387 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837823.995905:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a458d3c600/0x2deb895b363e6387 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837824.036892:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837824.451451:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837824.451909:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240275968 00000100:00100000:2.0:1788837824.451924:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240275968 00000100:00100000:2.0:1788837824.452008:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 174 00000100:00100000:2.0:1788837824.452021:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+9:5591:x1875732240275968:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837824.452046:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837824.452078:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a47bbb5200/0x2deb895b363e638e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0cf13 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837824.452150:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a47bbb5200/0x2deb895b363e638e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf13 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837824.452165:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a47bbb5200/0x2deb895b363e638e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf13 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837824.452195:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5200, rc 0) 00000100:00100000:2.0:1788837824.452312:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:5591:x1875732240275968:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 292us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837824.452320:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 174 00000100:00100000:1.0:1788837824.456153:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837824.456255:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240276096 00000100:00100000:3.0:1788837824.456272:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240276096 00000100:00100000:3.0:1788837824.456361:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 175 00000100:00100000:3.0:1788837824.456373:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:5591:x1875732240276096:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837824.456804:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:5591:x1875732240276096:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 430us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837824.456814:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 175 00000100:00100000:0.0:1788837824.459980:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837824.460071:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240276224 00000100:00100000:1.0:1788837824.460086:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240276224 00000100:00100000:1.0:1788837824.460173:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 176 00000100:00100000:1.0:1788837824.460185:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:5591:x1875732240276224:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837824.460501:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:5591:x1875732240276224:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 316us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837824.460512:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 176 00000100:00100000:1.0:1788837824.464429:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837824.464791:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240276352 00000100:00100000:3.0:1788837824.464805:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240276352 00000100:00100000:3.0:1788837824.464891:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 177 00000100:00100000:3.0:1788837824.464903:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:6145:x1875732240276352:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788837824.465286:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:6145:x1875732240276352:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 384us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837824.465307:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 177 00000100:00100000:1.0:1788837824.471458:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837824.472498:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240276480 00000100:00100000:2.0:1788837824.472517:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240276480 00000100:00100000:2.0:1788837824.472605:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 178 00000100:00100000:2.0:1788837824.472621:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:6145:x1875732240276480:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788837824.473331:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:6145:x1875732240276480:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 709us (1881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837824.473343:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 178 00000100:00100000:0.0:1788837824.674434:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788837824.674466:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448f93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254983808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837824.674574:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837824.674663:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254983808 00000100:00100000:0.0:1788837824.674674:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254983808 00000100:00100000:0.0:1788837824.674746:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788837824.674757:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254983808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788837824.674811:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837824.674866:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254983808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837824.674874:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788837824.674988:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a448f93100 x1875732254983808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837840 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837824.675009:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448f93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254983808:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788837824.675370:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837824.678270:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732254984320:0@lo:400:kworker.0 00000100:00100000:3.0:1788837824.678376:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837824.678427:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837824.678433:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732254983936:0@lo:400:kworker.0 00000100:00100000:3.0:1788837824.678461:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837824.678691:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732254984064:0@lo:400:kworker.0 00000100:00100000:3.0:1788837824.678720:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837824.678742:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837824.678748:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254984192:0@lo:400:kworker.0 00000100:00100000:3.0:1788837824.678774:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837824.678814:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254984320 00000100:00100000:3.0:1788837824.678823:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254984320 00000100:00100000:3.0:1788837824.678892:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254983936 00000100:00100000:3.0:1788837824.678895:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254983936 00000100:00100000:3.0:1788837824.678908:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254984064 00000100:00100000:3.0:1788837824.678929:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254984064 00000100:00100000:3.0:1788837824.679031:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788837824.679042:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1875732254984320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837824.679109:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1875732254984320:12345-0@lo:400:kworker.0 Request processed in 69us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837824.679117:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788837824.679150:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788837824.679157:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732254983936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837824.679188:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732254983936:12345-0@lo:400:kworker.0 Request processed in 32us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837824.679234:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788837824.679248:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788837824.679254:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732254984064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837824.679293:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732254984064:12345-0@lo:400:kworker.0 Request processed in 39us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837824.679300:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788837824.681789:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837824.681872:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732254983936:0@lo:400:kworker.0 00000100:00100000:0.0:1788837824.681890:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732254984320:0@lo:400:kworker.0 00000100:00100000:0.0:1788837824.681992:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732254984064:0@lo:400:kworker.0 00000100:00100000:3.0:1788837824.682390:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254984192 00000100:00100000:3.0:1788837824.682400:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254984192 00000100:00100000:3.0:1788837824.682633:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788837824.682647:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254984192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837824.682769:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254984192:12345-0@lo:400:kworker.0 Request processed in 125us (3993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837824.682778:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788837824.682849:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a46e7d7100 x1875732254984192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837824.682863:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254984192:0@lo:400:kworker.0 00010000:00010000:2.0:1788837825.059085:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788837825.127453:0:5805:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788837825.127466:0:5805:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a3451f4000 from 4 10000000:01000000:1.0:1788837825.127496:0:5805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788837825.127561:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a458d3c400/0x2deb895b363e6395 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837825.127577:0:5805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a458d3c400/0x2deb895b363e6395 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837825.127591:0:5805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a458d3c400/0x2deb895b363e6395 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837825.127626:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254984448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788837825.127765:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837825.127846:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a44a314d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788837825.127906:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254984448 00000100:00100000:1.0:1788837825.127917:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254984448 00000100:00100000:1.0:1788837825.127996:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788837825.128008:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:5805:x1875732254984448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837825.128028:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837825.128408:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a458d3ce00/0x2deb895b363e639c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e6395 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837825.128448:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a458d3ce00/0x2deb895b363e639c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e6395 expref: 17 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837825.128461:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a458d3ce00/0x2deb895b363e639c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e6395 expref: 17 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837825.128475:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3ce00, rc 0) 00000100:00100000:1.0:1788837825.128541:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:5805:x1875732254984448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 535us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837825.128564:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788837825.131916:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254984448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837825.131960:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a458d3c400/0x2deb895b363e6395 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e639c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837825.131976:0:5805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a458d3c400/0x2deb895b363e6395 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e639c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837825.132103:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448f93100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254984576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837825.132223:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837825.132286:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b52c300 going to sleep for 11 seconds 00000100:00100000:3.0:1788837825.132476:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254984576 00000100:00100000:3.0:1788837825.132485:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254984576 00000100:00100000:3.0:1788837825.132549:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788837825.132561:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:5805:x1875732254984576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837825.132935:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:5805:x1875732254984576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 376us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837825.132944:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788837825.133011:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448f93100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254984576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837825.133070:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254984704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837825.133118:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837825.133147:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448e43b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837825.133161:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254984704 00000100:00100000:3.0:1788837825.133165:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254984704 00000100:00100000:3.0:1788837825.133191:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788837825.133197:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:5805:x1875732254984704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837825.133385:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:5805:x1875732254984704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 187us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837825.133392:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788837825.133429:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254984704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837825.133686:0:8509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8509:1875732254984832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837825.133724:0:8509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837825.133743:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254984832 00000100:00100000:3.0:1788837825.133747:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254984832 00000100:00100000:3.0:1788837825.133769:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788837825.133776:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:8509:x1875732254984832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837825.133908:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:8509:x1875732254984832:12345-0@lo:502:llog_process_th.0 Request processed in 132us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837825.133916:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788837825.133954:0:8509:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448e43240 going to sleep for 11 seconds 00000100:00100000:3.0:1788837825.133967:0:8509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8509:1875732254984832:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788837825.133989:0:8509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788837825.134002:0:8509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837825.134004:0:8509:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788837825.134016:0:8509:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a3451f4000 00000020:00000080:3.0:1788837825.134018:0:8509:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788837825.134096:0:8509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8509:1875732254984960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837825.134144:0:8509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837825.134163:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254984960 00000100:00100000:3.0:1788837825.134166:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254984960 00000100:00100000:3.0:1788837825.134187:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788837825.134193:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:8509:x1875732254984960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837825.134334:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:8509:x1875732254984960:12345-0@lo:502:llog_process_th.0 Request processed in 141us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837825.134342:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788837825.134370:0:8509:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a46f4c4900 going to sleep for 11 seconds 00000100:00100000:3.0:1788837825.134383:0:8509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8509:1875732254984960:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788837825.134400:0:8509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837825.134404:0:8509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837825.134406:0:8509:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788837825.134410:0:8509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788837825.134470:0:5805:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788837825.134494:0:5805:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788837825.134505:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a458d3c400/0x2deb895b363e6395 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e639c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837825.134518:0:5805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a458d3c400/0x2deb895b363e6395 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e639c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837825.134538:0:5805:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788837825.134542:0:5805:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a448f86800 from 4 10000000:01000000:3.0:1788837825.134545:0:5805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788837825.134577:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e63a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837825.134586:0:5805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e63a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837825.134596:0:5805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e63a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837825.134611:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254985088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837825.134640:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837825.134654:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a46f4c4900 going to sleep for 11 seconds 00000100:00100000:3.0:1788837825.134667:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254985088 00000100:00100000:3.0:1788837825.134670:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254985088 00000100:00100000:3.0:1788837825.134691:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788837825.134698:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:5805:x1875732254985088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837825.134706:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837825.134721:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a44a48ac00/0x2deb895b363e63aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e63a3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837825.134747:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a44a48ac00/0x2deb895b363e63aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e63a3 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837825.134758:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a44a48ac00/0x2deb895b363e63aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e63a3 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837825.134780:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48ac00, rc 0) 00000100:00100000:3.0:1788837825.134809:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:5805:x1875732254985088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837825.134816:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788837825.134848:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254985088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837825.134862:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e63a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e63aa expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837825.134872:0:5805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e63a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e63aa expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837825.134915:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254985216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837825.134944:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837825.134957:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a46f4c4900 going to sleep for 11 seconds 00000100:00100000:3.0:1788837825.134968:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254985216 00000100:00100000:3.0:1788837825.134971:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254985216 00000100:00100000:3.0:1788837825.134992:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788837825.134997:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:5805:x1875732254985216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837825.148326:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:5805:x1875732254985216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 13313us (13366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837825.148346:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788837825.148674:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254985216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837825.148767:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448f91180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254985344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837825.148918:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837825.148969:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a450b87e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837825.149735:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254985344 00000100:00100000:3.0:1788837825.149749:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254985344 00000100:00100000:3.0:1788837825.150147:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788837825.150162:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:5805:x1875732254985344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837825.150470:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:5805:x1875732254985344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 311us (1552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837825.150478:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788837825.150553:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448f91180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254985344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837825.154198:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8512:1875732254985472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837825.154371:0:8512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837825.154430:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254985472 00000100:00100000:3.0:1788837825.154440:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254985472 00000100:00100000:3.0:1788837825.154502:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788837825.154512:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4551a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:8512:x1875732254985472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837825.154775:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4551a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:8512:x1875732254985472:12345-0@lo:502:llog_process_th.0 Request processed in 264us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837825.154784:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788837825.154856:0:8512:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a46f4c4900 going to sleep for 11 seconds 00000100:00100000:3.0:1788837825.154884:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8512:1875732254985472:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788837825.154930:0:8512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788837825.154943:0:8512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837825.154946:0:8512:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788837825.154958:0:8512:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a448f86800 00000020:00000080:3.0:1788837825.154961:0:8512:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788837825.158877:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8512:1875732254985600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837825.158992:0:8512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837825.159062:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254985600 00000100:00100000:3.0:1788837825.159071:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254985600 00000100:00100000:3.0:1788837825.159144:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788837825.159154:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4551ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:8512:x1875732254985600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837825.159458:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4551ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:8512:x1875732254985600:12345-0@lo:502:llog_process_th.0 Request processed in 304us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837825.159468:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788837825.159554:0:8512:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448e43240 going to sleep for 11 seconds 00000100:00100000:3.0:1788837825.159587:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8512:1875732254985600:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788837825.159625:0:8512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837825.159635:0:8512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837825.159638:0:8512:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788837825.159647:0:8512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788837825.159839:0:5805:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788837825.159881:0:5805:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788837825.159895:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e63a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e63aa expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837825.159909:0:5805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e63a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e63aa expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837825.159946:0:5805:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788837825.159949:0:5805:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a448c63800 from 4 10000000:01000000:2.0:1788837825.159952:0:5805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788837825.159999:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4000/0x2deb895b363e63b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837825.160009:0:5805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4000/0x2deb895b363e63b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837825.160020:0:5805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4000/0x2deb895b363e63b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837825.160049:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a409f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254985728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788837825.160145:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837825.160303:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a341083f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788837825.166766:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254985728 00000100:00100000:3.0:1788837825.166790:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254985728 00000100:00100000:3.0:1788837825.166881:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788837825.166894:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4551a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:5805:x1875732254985728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837825.166919:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837825.166947:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a44a48b600/0x2deb895b363e63b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e63b1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837825.166986:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a44a48b600/0x2deb895b363e63b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e63b1 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837825.167000:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a44a48b600/0x2deb895b363e63b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e63b1 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837825.167013:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48b600, rc 0) 00000100:00100000:3.0:1788837825.167127:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4551a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:5805:x1875732254985728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 236us (6982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837825.167145:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788837825.167244:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a409f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254985728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837825.167288:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4000/0x2deb895b363e63b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e63b8 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837825.167298:0:5805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4000/0x2deb895b363e63b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e63b8 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837825.167398:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254985856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837825.167438:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837825.167474:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448e43600 going to sleep for 11 seconds 00000100:00100000:3.0:1788837825.167491:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254985856 00000100:00100000:3.0:1788837825.167495:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254985856 00000100:00100000:3.0:1788837825.167520:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788837825.167527:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a460089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:5805:x1875732254985856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837825.167854:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a460089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:5805:x1875732254985856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 326us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837825.167863:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788837825.167898:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254985856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837825.167936:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254985984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837825.167982:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837825.167996:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448e43600 going to sleep for 11 seconds 00000100:00100000:3.0:1788837825.168008:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254985984 00000100:00100000:3.0:1788837825.168011:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254985984 00000100:00100000:0.0:1788837825.171553:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788837825.171591:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a460088c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:5805:x1875732254985984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837825.171960:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a460088c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:5805:x1875732254985984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 389us (3975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837825.171970:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788837825.173002:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732254985984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837825.176937:0:8513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a408000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8513:1875732254986112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837825.177047:0:8513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837825.177110:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254986112 00000100:00100000:2.0:1788837825.177118:0:8513:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a341083000 going to sleep for 11 seconds 00000100:00100000:0.0:1788837825.177126:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254986112 00000100:00100000:0.0:1788837825.177253:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788837825.177267:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:8513:x1875732254986112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837825.177588:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:8513:x1875732254986112:12345-0@lo:502:llog_process_th.0 Request processed in 323us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837825.177601:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788837825.177641:0:8513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a408000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8513:1875732254986112:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788837825.177711:0:8513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837825.177724:0:8513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837825.177726:0:8513:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788837825.177735:0:8513:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a448c63800 00000020:00000080:2.0:1788837825.177738:0:8513:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788837825.177823:0:8513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a408000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8513:1875732254986240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837825.177874:0:8513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837825.177908:0:8513:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a341083000 going to sleep for 11 seconds 00000100:00100000:0.0:1788837825.177928:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254986240 00000100:00100000:0.0:1788837825.177936:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254986240 00000100:00100000:0.0:1788837825.177972:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788837825.177980:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:8513:x1875732254986240:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837825.178144:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:8513:x1875732254986240:12345-0@lo:502:llog_process_th.0 Request processed in 165us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837825.178151:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788837825.178680:0:8513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a408000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:8513:1875732254986240:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788837825.178730:0:8513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837825.178739:0:8513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837825.178741:0:8513:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788837825.178746:0:8513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788837825.179379:0:5805:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788837825.179415:0:5805:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788837825.179431:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4000/0x2deb895b363e63b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e63b8 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837825.179460:0:5805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4000/0x2deb895b363e63b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e63b8 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837826.082338:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837827.108592:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837827.276606:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837827.276660:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837827.276784:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240276608 00000100:00100000:2.0:1788837827.276795:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240276608 00000100:00100000:2.0:1788837827.276857:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 194 00000100:00100000:2.0:1788837827.276868:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a56a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:2352:x1875732240276608:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788837827.276944:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a56a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:2352:x1875732240276608:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 78us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837827.276951:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 194 00000100:00100000:0.0:1788837827.277637:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837827.277669:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837827.277718:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240276736 00000100:00100000:3.0:1788837827.277724:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240276736 00000100:00100000:3.0:1788837827.277779:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:3.0:1788837827.277786:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2352:x1875732240276736:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788837827.277832:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2352:x1875732240276736:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 46us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837827.277839:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00080000:2.0:1788837827.280053:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837827.280944:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240276864 00000100:00100000:1.0:1788837827.280956:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240276864 00000100:00100000:1.0:1788837827.281236:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240276992 00000100:00100000:1.0:1788837827.281242:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240276992 00000100:00080000:0.0:1788837827.281294:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788837827.281298:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837827.281455:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:2.0:1788837827.281467:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2352:x1875732240276864:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788837827.281564:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2352:x1875732240276864:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 100us (4903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837827.281572:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:2.0:1788837827.281599:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:2.0:1788837827.281606:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2352:x1875732240276992:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788837827.281633:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2352:x1875732240276992:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 28us (3962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837827.281639:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00010000:00010000:1.0:1788837828.130593:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837828.258428:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448f93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254986368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837828.258501:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837828.258595:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254986368 00000100:00100000:2.0:1788837828.258604:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254986368 00000100:00100000:2.0:1788837828.258664:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788837828.258674:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254986368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837828.258713:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788837828.260603:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837828.264316:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254986368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5629us (5800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837828.264330:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788837828.264486:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a448f93100 x1875732254986368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837828.264514:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448f93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254986368:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788837829.157776:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837829.794604:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732254986752:0@lo:400:kworker.0 00000100:00100000:2.0:1788837829.794706:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837829.794781:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837829.794788:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254986880:0@lo:400:kworker.0 00000100:00100000:2.0:1788837829.794832:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837829.794940:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732254986496:0@lo:400:kworker.0 00000100:00100000:1.0:1788837829.794978:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837829.795012:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732254987008:0@lo:400:kworker.0 00000100:00100000:1.0:1788837829.795035:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837829.795066:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788837829.795072:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732254986624:0@lo:400:kworker.0 00000100:00100000:1.0:1788837829.795094:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837829.795109:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254987136:0@lo:400:kworker.0 00000100:00100000:1.0:1788837829.795130:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837829.795166:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254986752 00000100:00100000:1.0:1788837829.795174:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254986752 00000100:00100000:1.0:1788837829.795263:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254987008 00000100:00100000:1.0:1788837829.795267:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254987008 00000100:00100000:1.0:1788837829.795286:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254986624 00000100:00100000:1.0:1788837829.795298:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254986624 00000100:00100000:1.0:1788837829.795323:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788837829.795334:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a34735b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1875732254986752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837829.795417:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a34735b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1875732254986752:12345-0@lo:400:kworker.0 Request processed in 84us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837829.795426:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788837829.795446:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788837829.795454:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1875732254987008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837829.795488:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1875732254987008:12345-0@lo:400:kworker.0 Request processed in 35us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837829.795495:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788837829.795510:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788837829.795517:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732254986624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837829.795550:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732254986624:12345-0@lo:400:kworker.0 Request processed in 34us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837829.795557:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788837829.795579:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254986880 00000100:00100000:1.0:1788837829.795584:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254986880 00000100:00100000:1.0:1788837829.795609:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254987136 00000100:00100000:1.0:1788837829.795612:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254987136 00000100:00100000:1.0:1788837829.795632:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788837829.795637:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a347358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254986880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837829.795666:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a347358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254986880:12345-0@lo:400:kworker.0 Request processed in 29us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837829.795672:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788837829.795683:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788837829.795688:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254987136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837829.795723:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254987136:12345-0@lo:400:kworker.0 Request processed in 35us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837829.795728:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788837829.795767:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732254986624:0@lo:400:kworker.0 00010000:00080000:1.0:1788837829.795780:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a46f4b8e00 x1875732254987136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837829.795790:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254987136:0@lo:400:kworker.0 00000100:00100000:1.0:1788837829.795799:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732254987008:0@lo:400:kworker.0 00010000:00080000:1.0:1788837829.795835:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a46f4bb100 x1875732254986880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837829.795843:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254986880:0@lo:400:kworker.0 00000100:00100000:1.0:1788837829.795855:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732254986752:0@lo:400:kworker.0 00000100:00100000:2.0:1788837829.796183:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254986496 00000100:00100000:2.0:1788837829.796189:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254986496 00000100:00100000:2.0:1788837829.796259:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788837829.796266:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a56b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3271:x1875732254986496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837829.796305:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a56b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3271:x1875732254986496:12345-0@lo:400:kworker.0 Request processed in 40us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837829.796312:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788837829.796485:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732254986496:0@lo:400:kworker.0 00000100:00080000:3.0:1788837829.796641:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788837829.796646:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837829.798021:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254987264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837829.798100:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837829.802478:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254987264 00000100:00100000:2.0:1788837829.802495:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254987264 00000100:00100000:2.0:1788837829.802566:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788837829.802577:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254987264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788837829.802620:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837829.802777:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254987264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 202us (4677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837829.802798:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788837829.805981:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a46e7d7b80 x1875732254987264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837845 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837829.806175:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254987264:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788837830.178455:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837831.205027:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788837831.213504:0:8777:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1788837832.229151:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837832.394054:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837832.394493:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837832.394535:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240277120 00000100:00100000:0.0:1788837832.394547:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240277120 00000100:00100000:0.0:1788837832.394612:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 196 00000100:00100000:0.0:1788837832.394622:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:2350:x1875732240277120:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788837832.394697:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:2350:x1875732240277120:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 76us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837832.394704:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 196 00000100:00100000:1.0:1788837832.397372:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240277248 00000100:00100000:1.0:1788837832.397386:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240277248 00000100:00100000:1.0:1788837832.397593:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:1.0:1788837832.397614:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a347359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2350:x1875732240277248:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788837832.397713:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a347359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2350:x1875732240277248:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 102us (3221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837832.397720:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00080000:3.0:1788837832.398046:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837832.416288:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837832.416326:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837832.416354:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240277376 00000100:00100000:3.0:1788837832.416363:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240277376 00000100:00100000:3.0:1788837832.417137:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240277504 00000100:00100000:3.0:1788837832.417144:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240277504 00000100:00100000:3.0:1788837832.417257:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:1.0:1788837832.417267:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:3.0:1788837832.417273:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2348:x1875732240277376:12345-192.168.204.54@tcp:9:kworker.0 00000100:00100000:1.0:1788837832.417285:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2348:x1875732240277504:12345-192.168.204.54@tcp:9:kworker.0 00000020:00000080:3.0:1788837832.417317:0:6652:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e62f4 00000020:00000080:1.0:1788837832.417328:0:6650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e62fb 00000100:00080000:3.0:1788837832.417337:0:6652:0:(import.c:65:import_set_state_nolock()) ffff97a449445800 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1788837832.417340:0:6650:0:(import.c:65:import_set_state_nolock()) ffff97a346028800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788837832.418325:0:6652:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788837832.419713:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+2:2348:x1875732240277376:12345-192.168.204.54@tcp:9:kworker.0 Request processed in 2439us (3428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837832.419724:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000001:00000004:1.0:1788837832.420384:0:6650:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788837832.420724:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+2:2348:x1875732240277504:12345-192.168.204.54@tcp:9:kworker.0 Request processed in 3442us (4393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837832.420734:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00010000:00010000:1.0:1788837832.420761:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837832.421512:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788837832.421529:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788837832.421534:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788837833.250531:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837833.378454:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254987392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837833.378536:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837833.378644:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254987392 00000100:00100000:2.0:1788837833.378653:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254987392 00000100:00100000:2.0:1788837833.378731:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788837833.378741:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254987392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837833.378784:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837833.384070:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254987392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5318us (5520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837833.384086:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1788837833.384149:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788837833.385058:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a450ad0a80 x1875732254987392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837833.385086:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254987392:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788837834.274777:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837834.915814:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254987648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837834.915919:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837834.917645:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254987648 00000100:00100000:3.0:1788837834.917664:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254987648 00000100:00100000:3.0:1788837834.917748:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788837834.917760:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254987648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788837834.921774:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788837834.922128:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837834.922166:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a347358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732254987776:0@lo:400:kworker.0 00000100:00100000:2.0:1788837834.922234:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837834.922293:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837834.922300:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a347359f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732254987904:0@lo:400:kworker.0 00000100:00100000:2.0:1788837834.922325:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837834.929930:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a34735b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254988032:0@lo:400:kworker.0 00000100:00100000:3.0:1788837834.929964:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254987648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 12201us (14040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837834.929979:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788837834.930040:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788837834.930128:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a450ad0700 x1875732254987648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837850 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837834.930158:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254987648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837834.930182:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788837834.930190:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a34735a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732254987520:0@lo:400:kworker.0 00000100:00100000:0.0:1788837834.930247:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837834.930278:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a347359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732254988160:0@lo:400:kworker.0 00000100:00100000:0.0:1788837834.930307:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837834.930348:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254987520 00000100:00100000:0.0:1788837834.930357:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254987520 00000100:00100000:0.0:1788837834.930409:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788837834.930419:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3271:x1875732254987520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837834.930464:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254987776 00000100:00100000:3.0:1788837834.930469:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254987776 00000100:00100000:0.0:1788837834.930478:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3271:x1875732254987520:12345-0@lo:400:kworker.0 Request processed in 61us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837834.930485:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788837834.930500:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254987904 00000100:00100000:3.0:1788837834.930504:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254987904 00000100:00100000:0.0:1788837834.930515:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254988160 00000100:00100000:0.0:1788837834.930518:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254988160 00000100:00100000:3.0:1788837834.930531:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788837834.930536:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a34735bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732254987776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837834.930539:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788837834.930544:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a347359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1875732254987904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837834.930587:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a347359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1875732254987904:12345-0@lo:400:kworker.0 Request processed in 41us (8260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837834.930590:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a34735bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732254987776:12345-0@lo:400:kworker.0 Request processed in 54us (8358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837834.930597:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788837834.930602:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788837834.930622:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788837834.930628:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1875732254988160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837834.930658:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1875732254988160:12345-0@lo:400:kworker.0 Request processed in 30us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837834.930857:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254988032 00000100:00100000:2.0:1788837834.930865:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254988032 00000100:00100000:2.0:1788837834.930908:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788837834.930915:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254988032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837834.930969:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254988032:12345-0@lo:400:kworker.0 Request processed in 54us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837834.930979:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788837834.933966:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a347359f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732254987904:0@lo:400:kworker.0 00000100:00100000:0.0:1788837834.933993:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a347358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732254987776:0@lo:400:kworker.0 00000100:00100000:0.0:1788837834.934045:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a34735a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732254987520:0@lo:400:kworker.0 00000100:00100000:0.0:1788837834.934061:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a347359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732254988160:0@lo:400:kworker.0 00010000:00080000:0.0:1788837834.934082:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a34735b800 x1875732254988032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837834.934094:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a34735b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254988032:0@lo:400:kworker.0 00000100:00080000:0.0:1788837834.934149:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837834.934283:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:1.0:1788837835.298816:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788837835.517965:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7 00000020:00000080:2.0:1788837835.517987:0:6676:0:(genops.c:885:class_export_put()) final put ffff97a449445000/f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7 00000020:00000080:2.0:1788837835.518032:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a449445000/f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7 for lustre-OST0000 00000020:00000080:2.0:1788837835.518094:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a449445800 for lustre-OST0000 00000001:00100000:3.0:1788837836.018196:0:7611:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7 00000020:00000080:3.0:1788837836.018224:0:7611:0:(genops.c:885:class_export_put()) final put ffff97a34602b800/f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7 00000020:00000080:3.0:1788837836.018524:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a34602b800/f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7 for lustre-OST0001 00000020:00000080:3.0:1788837836.038724:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a346028800 for lustre-OST0001 00010000:00010000:2.0:1788837836.328361:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788837837.166318:0:9026:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing yml_node 00010000:00010000:3.0:1788837837.347390:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837837.528821:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837837.528870:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837837.528927:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240277632 00000100:00100000:3.0:1788837837.528942:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240277632 00000100:00100000:3.0:1788837837.529326:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 198 00000100:00100000:3.0:1788837837.529340:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:2350:x1875732240277632:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788837837.529926:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240277760 00000100:00100000:0.0:1788837837.529936:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240277760 00000100:00100000:0.0:1788837837.530012:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:0.0:1788837837.530022:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2350:x1875732240277760:12345-192.168.204.54@tcp:400:kworker.0 00000100:00080000:1.0:1788837837.530112:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837837.534417:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:2350:x1875732240277632:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 5064us (5595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837837.534437:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 198 00000100:00100000:0.0:1788837837.534635:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2350:x1875732240277760:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 4612us (5761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837837.534647:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 44 00010000:00010000:1.0:1788837838.370683:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837838.500243:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254988288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837838.500344:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837838.501255:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254988288 00000100:00100000:3.0:1788837838.501273:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254988288 00000100:00100000:3.0:1788837838.501365:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788837838.501377:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254988288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788837838.501452:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788837838.501561:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254988288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 187us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837838.501569:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788837838.501600:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788837838.501802:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a46e7d4a80 x1875732254988288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837838.501832:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254988288:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788837839.401313:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837840.035545:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a347358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3274:1875732254988416:0@lo:400:kworker.0 00000100:00100000:3.0:1788837840.035672:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837840.035746:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a34735b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3274:1875732254988928:0@lo:400:kworker.0 00000100:00100000:3.0:1788837840.035780:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837840.035809:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788837840.035815:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a347358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254988800:0@lo:400:kworker.0 00000100:00100000:3.0:1788837840.035855:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837840.035897:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254988800 00000100:00100000:3.0:1788837840.035907:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254988800 00000100:00100000:3.0:1788837840.035979:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788837840.035989:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254988800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837840.036071:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254988800:12345-0@lo:400:kworker.0 Request processed in 82us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837840.036079:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788837840.036108:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788837840.036249:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a347358a80 x1875732254988800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837840.036293:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a347358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254988800:0@lo:400:kworker.0 00000100:00100000:2.0:1788837840.036810:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254988416 00000100:00100000:2.0:1788837840.036820:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254988416 00000100:00100000:2.0:1788837840.036892:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788837840.036901:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3274:x1875732254988416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837840.036964:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3274:x1875732254988416:12345-0@lo:400:kworker.0 Request processed in 65us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837840.036972:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788837840.037033:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a347358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3274:1875732254988416:0@lo:400:kworker.0 00000100:00100000:0.0:1788837840.037237:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a34735aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732254988544:0@lo:400:kworker.0 00000100:00100000:0.0:1788837840.037283:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837840.037307:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a347359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254989056:0@lo:400:kworker.0 00000100:00100000:0.0:1788837840.037349:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837840.037375:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837840.037382:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a34735ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732254988672:0@lo:400:kworker.0 00000100:00100000:0.0:1788837840.037406:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837840.037442:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254988928 00000100:00100000:0.0:1788837840.037448:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254988928 00000100:00100000:0.0:1788837840.037508:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254988544 00000100:00100000:0.0:1788837840.037512:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254988544 00000100:00100000:0.0:1788837840.037528:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254988672 00000100:00100000:0.0:1788837840.037531:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254988672 00000100:00100000:0.0:1788837840.037546:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788837840.037552:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1875732254988928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837840.037594:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1875732254988928:12345-0@lo:400:kworker.0 Request processed in 42us (1813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837840.037601:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788837840.037615:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788837840.037886:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732254988544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837840.037935:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732254988544:12345-0@lo:400:kworker.0 Request processed in 54us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837840.037940:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788837840.037953:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788837840.037960:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732254988672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837840.037986:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732254988672:12345-0@lo:400:kworker.0 Request processed in 28us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837840.037994:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788837840.038016:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254989056 00000100:00100000:0.0:1788837840.038020:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254989056 00000100:00100000:0.0:1788837840.038138:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788837840.038144:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254989056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837840.038372:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a34735b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3274:1875732254988928:0@lo:400:kworker.0 00000100:00080000:2.0:1788837840.038432:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788837840.038438:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837840.038472:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a34735ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732254988672:0@lo:400:kworker.0 00000100:00100000:2.0:1788837840.038499:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a34735aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732254988544:0@lo:400:kworker.0 00010000:00080000:2.0:1788837840.038516:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a347359500 x1875732254989056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837840.038527:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a347359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254989056:0@lo:400:kworker.0 00000100:00100000:0.0:1788837840.038791:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254989056:12345-0@lo:400:kworker.0 Request processed in 36us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837840.038799:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788837840.039387:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837840.039409:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254989184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837840.039475:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837840.039768:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254989184 00000100:00100000:3.0:1788837840.039778:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254989184 00000100:00100000:3.0:1788837840.039838:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788837840.039858:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a347359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254989184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788837840.039902:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788837840.040002:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a347359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254989184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837840.040009:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788837840.053164:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a450ad1c00 x1875732254989184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837856 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837840.053756:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254989184:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788837840.418918:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837841.442376:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788837842.315073:0:9218:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.117 00010000:00010000:1.0:1788837842.468256:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837842.632393:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837842.632451:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837842.632484:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240277888 00000100:00100000:0.0:1788837842.632496:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240277888 00000100:00100000:0.0:1788837842.632551:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 200 00000100:00100000:0.0:1788837842.632561:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a56bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:2352:x1875732240277888:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788837842.632635:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a56bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:2352:x1875732240277888:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 75us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837842.632642:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 200 00000100:00100000:3.0:1788837842.632787:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240278016 00000100:00100000:3.0:1788837842.632802:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240278016 00000100:00100000:3.0:1788837842.632856:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:3.0:1788837842.632863:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2351:x1875732240278016:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788837842.632896:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2351:x1875732240278016:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 34us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837842.632904:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00080000:0.0:1788837842.633305:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788837843.490755:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837843.618950:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837843.618975:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254989312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837843.619045:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837843.619230:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254989312 00000100:00100000:1.0:1788837843.619239:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254989312 00000100:00100000:1.0:1788837843.619298:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788837843.619309:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a34735aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254989312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788837843.619348:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837843.619399:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a34735aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254989312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837843.619418:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788837843.619464:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a450ad3800 x1875732254989312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837843.619483:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254989312:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788837843.619585:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788837844.515577:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837845.155508:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a34735ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254989440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837845.155582:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837845.155655:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254989440 00000100:00100000:2.0:1788837845.155662:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254989440 00000100:00100000:2.0:1788837845.155718:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788837845.155728:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a34735b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254989440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788837845.155792:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837845.155845:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a34735b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254989440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837845.155853:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1788837845.155877:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788837845.155910:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a34735ad80 x1875732254989440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837861 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837845.155943:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a34735ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254989440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837845.156483:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3272:1875732254989696:0@lo:400:kworker.0 00000100:00100000:3.0:1788837845.156535:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837845.156573:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788837845.156579:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732254989568:0@lo:400:kworker.0 00000100:00100000:3.0:1788837845.156610:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837845.156638:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3272:1875732254990080:0@lo:400:kworker.0 00000100:00100000:3.0:1788837845.156662:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837845.156707:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254989568 00000100:00100000:3.0:1788837845.156714:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254989568 00000100:00100000:3.0:1788837845.156775:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788837845.156784:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3272:x1875732254989568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837845.156825:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3272:x1875732254989568:12345-0@lo:400:kworker.0 Request processed in 43us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837845.156833:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788837845.156879:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732254989568:0@lo:400:kworker.0 00000100:00100000:0.0:1788837845.157052:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254989696 00000100:00100000:0.0:1788837845.157058:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254989696 00000100:00100000:0.0:1788837845.157098:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254990080 00000100:00100000:0.0:1788837845.157111:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254990080 00000100:00100000:0.0:1788837845.157138:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788837845.157146:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1875732254989696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837845.157187:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1875732254989696:12345-0@lo:400:kworker.0 Request processed in 43us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837845.157193:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788837845.157238:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788837845.157246:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3272:x1875732254990080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837845.157282:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3272:x1875732254990080:12345-0@lo:400:kworker.0 Request processed in 38us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837845.157289:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788837845.157427:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3272:1875732254990080:0@lo:400:kworker.0 00000100:00100000:3.0:1788837845.157436:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3272:1875732254989696:0@lo:400:kworker.0 00000100:00100000:2.0:1788837845.157608:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732254989824:0@lo:400:kworker.0 00000100:00100000:2.0:1788837845.157638:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837845.157664:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837845.157670:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254989952:0@lo:400:kworker.0 00000100:00100000:2.0:1788837845.157708:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788837845.157740:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837845.157858:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254989952 00000100:00100000:3.0:1788837845.157864:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254989952 00000100:00100000:3.0:1788837845.157907:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788837845.157913:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a347358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254989952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837845.157957:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a347358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254989952:12345-0@lo:400:kworker.0 Request processed in 44us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837845.157963:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788837845.158084:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254989824 00000100:00100000:0.0:1788837845.158088:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254989824 00000100:00100000:0.0:1788837845.158129:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788837845.158136:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a34735ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1875732254989824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837845.158169:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a34735ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1875732254989824:12345-0@lo:400:kworker.0 Request processed in 34us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837845.158175:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1788837845.162736:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788837845.162763:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788837845.162817:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a46f4d1180 x1875732254989952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837845.162835:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254989952:0@lo:400:kworker.0 00000100:00100000:2.0:1788837845.162849:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732254989824:0@lo:400:kworker.0 00000001:02000400:1.0:1788837845.389959:0:9315:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.117 00010000:00010000:1.0:1788837845.539083:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837846.573579:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837847.586442:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837847.759387:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837847.759484:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837847.769673:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240278144 00000100:00100000:3.0:1788837847.769708:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240278144 00000100:00100000:3.0:1788837847.769802:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 202 00000100:00100000:3.0:1788837847.769815:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a56b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:2352:x1875732240278144:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788837847.769928:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a56b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:2352:x1875732240278144:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 116us (10555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837847.769938:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 202 00000100:00100000:3.0:1788837847.769990:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240278272 00000100:00100000:3.0:1788837847.770004:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240278272 00000100:00100000:3.0:1788837847.770057:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:3.0:1788837847.770064:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a347358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2352:x1875732240278272:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788837847.770102:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a347358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2352:x1875732240278272:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 39us (10618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837847.770109:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00080000:3.0:1788837847.770319:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1788837848.123632:0:9413:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.117 00010000:00010000:0.0:1788837848.611003:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837848.740149:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254990208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837848.740984:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837848.741924:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254990208 00000100:00100000:1.0:1788837848.741944:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254990208 00000100:00100000:1.0:1788837848.742049:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788837848.742060:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732254990208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788837848.742113:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837848.742178:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732254990208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837848.742185:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788837848.742911:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788837848.742952:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a450ad3800 x1875732254990208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837848.742974:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254990208:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788837849.645728:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788837850.032587:0:9461:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Sep 7 23:24:07 EDT 2026 00000100:00100000:1.0:1788837850.275894:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732254990336:0@lo:400:kworker.0 00000100:00100000:1.0:1788837850.275978:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837850.276027:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732254990848:0@lo:400:kworker.0 00000100:00100000:1.0:1788837850.276053:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837850.276081:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788837850.276087:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732254990464:0@lo:400:kworker.0 00000100:00100000:1.0:1788837850.276110:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837850.276128:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254990976:0@lo:400:kworker.0 00000100:00100000:1.0:1788837850.276153:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837850.276182:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732254990592:0@lo:400:kworker.0 00000100:00100000:1.0:1788837850.276247:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837850.276266:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788837850.276272:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254990720:0@lo:400:kworker.0 00000100:00100000:1.0:1788837850.276290:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837850.276322:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254990336 00000100:00100000:1.0:1788837850.276329:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254990336 00000100:00100000:1.0:1788837850.276373:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788837850.276381:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3273:x1875732254990336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837850.276430:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3273:x1875732254990336:12345-0@lo:400:kworker.0 Request processed in 49us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837850.276437:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788837850.276467:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254990848 00000100:00100000:1.0:1788837850.276471:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254990848 00000100:00100000:1.0:1788837850.276506:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254990464 00000100:00100000:1.0:1788837850.276509:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254990464 00000100:00100000:1.0:1788837850.276522:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254990592 00000100:00100000:1.0:1788837850.276524:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254990592 00000100:00100000:1.0:1788837850.276537:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788837850.276543:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1875732254990848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837850.276575:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1875732254990848:12345-0@lo:400:kworker.0 Request processed in 32us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837850.276581:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788837850.276592:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788837850.276597:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732254990464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837850.276621:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732254990464:12345-0@lo:400:kworker.0 Request processed in 24us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837850.276626:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788837850.276657:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788837850.276664:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732254990592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837850.276698:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732254990592:12345-0@lo:400:kworker.0 Request processed in 35us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837850.276704:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788837850.276726:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254990976 00000100:00100000:1.0:1788837850.276730:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254990976 00000100:00100000:1.0:1788837850.276754:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254990720 00000100:00100000:1.0:1788837850.276757:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254990720 00000100:00100000:1.0:1788837850.276775:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788837850.276782:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254990976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837850.276814:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254990976:12345-0@lo:400:kworker.0 Request processed in 32us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837850.276820:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788837850.276831:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788837850.276837:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254990720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837850.276863:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254990720:12345-0@lo:400:kworker.0 Request processed in 27us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837850.276869:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788837850.276893:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788837850.276897:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788837850.276899:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788837850.276932:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a450ad3b80 x1875732254990720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837850.276947:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254990720:0@lo:400:kworker.0 00000100:00100000:1.0:1788837850.276958:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732254990592:0@lo:400:kworker.0 00000100:00100000:1.0:1788837850.276998:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732254990464:0@lo:400:kworker.0 00010000:00080000:1.0:1788837850.277008:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a450ad1c00 x1875732254990976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837850.277017:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254990976:0@lo:400:kworker.0 00000100:00100000:1.0:1788837850.277025:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732254990336:0@lo:400:kworker.0 00000100:00100000:1.0:1788837850.277034:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732254990848:0@lo:400:kworker.0 00000100:00100000:1.0:1788837850.279299:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837850.279326:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254991104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837850.279418:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837850.279483:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254991104 00000100:00100000:1.0:1788837850.279491:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254991104 00000100:00100000:1.0:1788837850.279559:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788837850.279570:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732254991104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837850.279611:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837850.279673:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732254991104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837850.279682:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1788837850.279731:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a46f4b8000 x1875732254991104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837866 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837850.279755:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254991104:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788837850.658633:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837851.684253:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837852.706397:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837852.872027:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837852.872078:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837852.872251:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240278400 00000100:00100000:0.0:1788837852.872264:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240278400 00000100:00100000:0.0:1788837852.872324:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 204 00000100:00100000:0.0:1788837852.872334:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:2351:x1875732240278400:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788837852.872427:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:2351:x1875732240278400:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 94us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837852.872434:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 204 00000100:00100000:1.0:1788837852.872681:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240278528 00000100:00100000:1.0:1788837852.872687:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240278528 00000100:00100000:0.0:1788837852.872869:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:0.0:1788837852.872878:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2351:x1875732240278528:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788837852.872920:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2351:x1875732240278528:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 43us (904us total) trans 0 rc 0/0 00000100:00080000:3.0:1788837852.872921:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837852.872930:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 56 00010000:00010000:0.0:1788837853.730695:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837853.859474:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254991232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837853.859556:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837853.859787:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254991232 00000100:00100000:1.0:1788837853.859808:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254991232 00000100:00100000:1.0:1788837853.859876:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788837853.859885:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a34735a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732254991232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788837853.859920:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837853.859985:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a34735a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732254991232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837853.859991:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788837853.860052:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a46f4b8000 x1875732254991232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837869 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788837853.860062:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837853.860085:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254991232:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788837854.758170:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837855.397245:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837855.397271:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254991360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837855.397351:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837855.397410:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254991360 00000100:00100000:1.0:1788837855.397417:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254991360 00000100:00100000:1.0:1788837855.397470:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788837855.397479:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254991360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837855.397513:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837855.397564:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254991360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837855.397572:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788837855.397592:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788837855.397618:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a46f4b8000 x1875732254991360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837871 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837855.397637:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254991360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837855.397787:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a34735b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732254991616:0@lo:400:kworker.0 00000100:00100000:2.0:1788837855.397819:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837855.397843:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837855.397849:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a347359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732254991744:0@lo:400:kworker.0 00000100:00100000:2.0:1788837855.397889:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837855.397921:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254991616 00000100:00100000:2.0:1788837855.397925:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254991616 00000100:00100000:2.0:1788837855.397953:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254991744 00000100:00100000:2.0:1788837855.397956:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254991744 00000100:00100000:1.0:1788837855.398149:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a347358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3274:1875732254991488:0@lo:400:kworker.0 00000100:00100000:1.0:1788837855.398182:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837855.398226:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a347358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3274:1875732254992000:0@lo:400:kworker.0 00000100:00100000:1.0:1788837855.398249:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837855.398628:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a34735a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254991872:0@lo:400:kworker.0 00000100:00100000:0.0:1788837855.398663:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837855.398698:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254991872 00000100:00100000:0.0:1788837855.398703:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254991872 00000100:00100000:0.0:1788837855.398737:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788837855.398746:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254991872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837855.398789:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254991872:12345-0@lo:400:kworker.0 Request processed in 45us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837855.398796:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788837855.398830:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a34735a300 x1875732254991872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837855.398843:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a34735a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254991872:0@lo:400:kworker.0 00000100:00100000:0.0:1788837855.398893:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254991488 00000100:00100000:0.0:1788837855.398897:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254991488 00000100:00100000:0.0:1788837855.398923:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788837855.398929:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3274:x1875732254991488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837855.398960:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3274:x1875732254991488:12345-0@lo:400:kworker.0 Request processed in 31us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837855.398966:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00080000:3.0:1788837855.400305:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788837855.400313:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837855.400525:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a347358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3274:1875732254991488:0@lo:400:kworker.0 00000100:00100000:2.0:1788837855.400821:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254992000 00000100:00100000:2.0:1788837855.400828:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254992000 00000100:00100000:2.0:1788837855.400895:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788837855.400905:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a347359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732254991616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837855.400981:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a347359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732254991616:12345-0@lo:400:kworker.0 Request processed in 77us (3160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837855.400988:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788837855.401006:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788837855.401012:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732254991744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837855.401042:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732254991744:12345-0@lo:400:kworker.0 Request processed in 31us (3153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837855.401048:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788837855.401073:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788837855.401079:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1875732254992000:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788837855.401185:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837855.401258:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1875732254992000:12345-0@lo:400:kworker.0 Request processed in 178us (3007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837855.401264:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788837855.401297:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a347359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732254991744:0@lo:400:kworker.0 00000100:00100000:2.0:1788837855.401308:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a34735b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732254991616:0@lo:400:kworker.0 00000100:00100000:1.0:1788837855.401458:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a347358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3274:1875732254992000:0@lo:400:kworker.0 00010000:00010000:0.0:1788837855.783063:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837856.804111:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837857.826594:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837858.014039:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837858.014098:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837858.014246:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240278784 00000100:00100000:2.0:1788837858.014255:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240278784 00000100:00100000:2.0:1788837858.014324:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:2.0:1788837858.014334:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2351:x1875732240278784:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788837858.014401:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2351:x1875732240278784:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 69us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837858.014408:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:1.0:1788837858.014930:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240278656 00000100:00100000:1.0:1788837858.014936:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240278656 00000100:00100000:1.0:1788837858.014982:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 206 00000100:00100000:1.0:1788837858.014990:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:2352:x1875732240278656:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788837858.015024:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:2352:x1875732240278656:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 35us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837858.015030:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 206 00000100:00080000:3.0:1788837858.015809:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788837858.852769:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837858.978611:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254992128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837858.978706:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837858.978893:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254992128 00000100:00100000:1.0:1788837858.978902:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254992128 00000100:00100000:1.0:1788837858.978974:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788837858.978984:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254992128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788837858.979020:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837858.979082:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254992128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837858.979089:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788837858.979151:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788837858.979852:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a450ad1c00 x1875732254992128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837858.979889:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254992128:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788837859.877315:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837860.514659:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254992256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837860.514812:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837860.514939:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254992256 00000100:00100000:1.0:1788837860.514948:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254992256 00000100:00100000:1.0:1788837860.515011:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788837860.515021:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732254992256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837860.515056:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837860.515105:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732254992256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837860.515128:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1788837860.515169:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a450ad0000 x1875732254992256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837860.515188:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254992256:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788837860.516050:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837860.516081:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732254992640:0@lo:400:kworker.0 00000100:00100000:2.0:1788837860.516125:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837860.516151:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837860.516157:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254992768:0@lo:400:kworker.0 00000100:00100000:3.0:1788837860.516179:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254992640 00000100:00100000:2.0:1788837860.516182:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837860.516184:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254992640 00000100:00080000:2.0:1788837860.516246:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837860.516257:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254992768 00000100:00100000:2.0:1788837860.516260:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254992768 00000100:00100000:2.0:1788837860.516299:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788837860.516309:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254992768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837860.516355:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254992768:12345-0@lo:400:kworker.0 Request processed in 48us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837860.516362:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1788837860.516379:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788837860.516400:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a4496e0a80 x1875732254992768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837860.516411:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254992768:0@lo:400:kworker.0 00000100:00100000:0.0:1788837860.516540:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732254992384:0@lo:400:kworker.0 00000100:00100000:1.0:1788837860.516688:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3274:1875732254992512:0@lo:400:kworker.0 00000100:00100000:1.0:1788837860.517623:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837860.517872:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254992512 00000100:00100000:3.0:1788837860.517880:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254992512 00000100:00100000:3.0:1788837860.517907:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788837860.517916:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732254992640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837860.517920:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788837860.517927:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1875732254992512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837860.518000:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837860.519472:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732254992640:12345-0@lo:400:kworker.0 Request processed in 1549us (3338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837860.519483:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788837860.519987:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732254992640:0@lo:400:kworker.0 00000100:00100000:1.0:1788837860.520589:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254992384 00000100:00100000:1.0:1788837860.520606:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254992384 00000100:00100000:1.0:1788837860.520660:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788837860.520668:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3273:x1875732254992384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837860.520756:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3273:x1875732254992384:12345-0@lo:400:kworker.0 Request processed in 87us (4179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837860.520763:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788837860.526956:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3274:1875732254992512:0@lo:400:kworker.0 00000100:00100000:2.0:1788837860.527054:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1875732254992512:12345-0@lo:400:kworker.0 Request processed in 9123us (9430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837860.527065:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788837860.527995:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732254992384:0@lo:400:kworker.0 00000100:00100000:0.0:1788837860.528009:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732254992896:0@lo:400:kworker.0 00000100:00100000:0.0:1788837860.528070:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837860.528294:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254992896 00000100:00100000:1.0:1788837860.528302:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254992896 00000100:00100000:1.0:1788837860.528973:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788837860.528986:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1875732254992896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837860.529055:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1875732254992896:12345-0@lo:400:kworker.0 Request processed in 73us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837860.529062:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788837860.529348:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732254992896:0@lo:400:kworker.0 00000100:00080000:2.0:1788837860.529404:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788837860.899946:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837861.925377:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837862.946435:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837863.111928:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837863.111981:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837863.112131:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240278912 00000100:00100000:0.0:1788837863.112142:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240278912 00000100:00100000:0.0:1788837863.112236:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 208 00000100:00100000:0.0:1788837863.112249:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:2351:x1875732240278912:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788837863.112319:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:2351:x1875732240278912:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 73us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837863.112328:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 208 00000100:00100000:2.0:1788837863.112436:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240279040 00000100:00100000:2.0:1788837863.112441:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240279040 00000100:00100000:2.0:1788837863.112525:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:2.0:1788837863.112533:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2351:x1875732240279040:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788837863.112571:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2351:x1875732240279040:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 39us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837863.112579:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00080000:0.0:1788837863.112651:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788837863.971794:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837864.100944:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254993024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837864.101026:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837864.101559:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254993024 00000100:00100000:1.0:1788837864.101590:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254993024 00000100:00100000:2.0:1788837864.101801:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788837864.101813:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254993024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837864.101849:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837864.101913:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254993024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837864.101921:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1788837864.102015:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a450ad1880 x1875732254993024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837864.102035:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254993024:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788837864.102120:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788837864.997840:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837865.641917:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3272:1875732254993280:0@lo:400:kworker.0 00000100:00100000:1.0:1788837865.642043:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837865.642101:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732254993152:0@lo:400:kworker.0 00000100:00100000:1.0:1788837865.642140:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254993792:0@lo:400:kworker.0 00000100:00100000:0.0:1788837865.642188:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837865.642404:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732254993664:0@lo:400:kworker.0 00000100:00100000:0.0:1788837865.642435:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837865.642479:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732254993408:0@lo:400:kworker.0 00000100:00100000:0.0:1788837865.642507:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837865.642527:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788837865.642532:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254993536:0@lo:400:kworker.0 00000100:00100000:0.0:1788837865.642559:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837865.642746:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837865.642749:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254993152 00000100:00100000:0.0:1788837865.642760:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254993152 00000100:00100000:1.0:1788837865.642796:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254993280 00000100:00100000:1.0:1788837865.642802:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254993280 00000100:00100000:0.0:1788837865.642829:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788837865.642842:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3271:x1875732254993152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837865.642844:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254993664 00000100:00100000:1.0:1788837865.642849:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254993664 00000100:00100000:1.0:1788837865.642882:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254993408 00000100:00100000:1.0:1788837865.642885:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254993408 00000100:00100000:1.0:1788837865.642906:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788837865.642914:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3271:x1875732254993152:12345-0@lo:400:kworker.0 Request processed in 75us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837865.642916:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1875732254993280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837865.642930:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788837865.642973:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1875732254993280:12345-0@lo:400:kworker.0 Request processed in 59us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837865.642981:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788837865.642991:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1875732254993664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837865.642997:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788837865.643018:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788837865.643027:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1875732254993408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837865.643033:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1875732254993664:12345-0@lo:400:kworker.0 Request processed in 43us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837865.643042:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788837865.643072:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1875732254993408:12345-0@lo:400:kworker.0 Request processed in 47us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837865.643075:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254993536 00000100:00100000:0.0:1788837865.643082:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254993536 00000100:00100000:1.0:1788837865.643083:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788837865.643117:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254993792 00000100:00100000:0.0:1788837865.643121:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254993792 00000100:00100000:1.0:1788837865.643138:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3272:1875732254993280:0@lo:400:kworker.0 00000100:00100000:2.0:1788837865.643260:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788837865.643271:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a347358000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254993536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837865.643310:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a347358000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254993536:12345-0@lo:400:kworker.0 Request processed in 43us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837865.643317:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788837865.643364:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837865.643412:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837865.643426:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254993920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837865.643462:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788837865.643545:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a46f4b8000 x1875732254993536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837865.643557:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254993536:0@lo:400:kworker.0 00000100:00100000:3.0:1788837865.643568:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732254993408:0@lo:400:kworker.0 00000100:00100000:3.0:1788837865.643594:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732254993152:0@lo:400:kworker.0 00000100:00100000:3.0:1788837865.643604:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732254993664:0@lo:400:kworker.0 00000100:00100000:2.0:1788837865.643711:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254993920 00000100:00100000:2.0:1788837865.643716:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254993920 00000100:00100000:2.0:1788837865.643768:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788837865.643776:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459204e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254993920:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788837865.643794:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1788837865.643813:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837865.643865:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459204e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254993920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837865.643883:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1788837865.643926:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a46e7d6300 x1875732254993920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837865.643945:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254993920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837865.644316:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788837865.644324:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459206300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732254993792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837865.644403:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459206300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732254993792:12345-0@lo:400:kworker.0 Request processed in 79us (1658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837865.644410:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1788837865.645049:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a44a409f80 x1875732254993792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837865.645065:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254993792:0@lo:400:kworker.0 00010000:00010000:0.0:1788837866.019431:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788837866.121182:0:10090:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 23:24:23 (1788837863) === 00000100:00100000:1.0:1788837866.607015:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837866.607125:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240279168 00000100:00100000:3.0:1788837866.607139:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240279168 00000100:00100000:3.0:1788837866.607255:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 210 00000100:00100000:3.0:1788837866.607270:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:8147:x1875732240279168:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788837866.607315:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837866.607352:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a44a48b400/0x2deb895b363e63bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0cf1a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837866.607397:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a44a48b400/0x2deb895b363e63bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf1a expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837866.607412:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a44a48b400/0x2deb895b363e63bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf1a expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837866.607424:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48b400, rc 0) 00000100:00100000:3.0:1788837866.607588:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+11:8147:x1875732240279168:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 321us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837866.607597:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 210 00000100:00100000:3.0:1788837866.615643:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837866.616834:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240279296 00000100:00100000:1.0:1788837866.616851:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240279296 00000100:00100000:1.0:1788837866.617104:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 211 00000100:00100000:1.0:1788837866.617119:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+11:8147:x1875732240279296:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788837866.617859:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+11:8147:x1875732240279296:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 741us (2227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837866.617870:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 211 00000100:00100000:1.0:1788837866.622634:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837866.622948:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240279424 00000100:00100000:0.0:1788837866.623090:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240279424 00000100:00100000:0.0:1788837866.623486:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 212 00000100:00100000:0.0:1788837866.623500:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+11:8147:x1875732240279424:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788837866.626159:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+11:8147:x1875732240279424:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 2647us (3525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837866.626178:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 212 00000100:00100000:2.0:1788837866.635050:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837866.635532:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240279552 00000100:00100000:1.0:1788837866.635546:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240279552 00000100:00100000:1.0:1788837866.635622:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 213 00000100:00100000:1.0:1788837866.635634:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+11:8151:x1875732240279552:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788837866.636182:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+11:8151:x1875732240279552:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 546us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837866.636193:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 213 00000100:00100000:3.0:1788837866.681460:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837866.682131:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240279680 00000100:00100000:1.0:1788837866.682147:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240279680 00000100:00100000:1.0:1788837866.682880:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 214 00000100:00100000:1.0:1788837866.682897:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+11:8151:x1875732240279680:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788837866.685463:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+11:8151:x1875732240279680:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 2553us (3999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837866.685481:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 214 00000100:00100000:2.0:1788837866.691114:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837866.691288:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240279808 00000100:00100000:3.0:1788837866.691303:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240279808 00000100:00100000:3.0:1788837866.691402:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 215 00000100:00100000:3.0:1788837866.691415:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+11:8147:x1875732240279808:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788837866.691441:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837866.691467:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a44a48a600/0x2deb895b363e63c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0cf44 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837866.691507:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a44a48a600/0x2deb895b363e63c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf44 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837866.691531:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a44a48a600/0x2deb895b363e63c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf44 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837866.691565:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48a600, rc 0) 00000100:00100000:3.0:1788837866.692366:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+12:8147:x1875732240279808:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 947us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837866.692377:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 215 00000100:00100000:0.0:1788837866.698981:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837866.699184:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240279936 00000100:00100000:1.0:1788837866.699199:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240279936 00000100:00100000:1.0:1788837866.699397:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 216 00000100:00100000:1.0:1788837866.699410:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+12:8147:x1875732240279936:12345-192.168.204.54@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788837866.699446:0:5800:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788837866.699477:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788837866.699482:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788837866.699501:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788837866.699503:0:5800:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788837866.701986:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+12:8147:x1875732240279936:12345-192.168.204.54@tcp:256:mount.lustre.0 Request processed in 2558us (2999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837866.702007:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 216 00000100:00100000:2.0:1788837866.706104:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837866.706419:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240280064 00000100:00100000:3.0:1788837866.706439:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240280064 00000100:00100000:2.0:1788837866.708974:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 217 00000100:00100000:2.0:1788837866.709002:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+12:8147:x1875732240280064:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788837866.709028:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837866.709055:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a47bbb4200/0x2deb895b363e63cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0cf4b expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837866.709103:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a47bbb4200/0x2deb895b363e63cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf4b expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837866.709119:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a47bbb4200/0x2deb895b363e63cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf4b expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837866.709132:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4200, rc 0) 00000100:00100000:2.0:1788837866.709256:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:8147:x1875732240280064:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 258us (3167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837866.709264:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 217 00000100:00100000:0.0:1788837866.713458:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837866.715761:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240280192 00000100:00100000:1.0:1788837866.715787:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240280192 00000100:00100000:1.0:1788837866.715888:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 218 00000100:00100000:1.0:1788837866.715901:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:8147:x1875732240280192:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788837866.716398:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:8147:x1875732240280192:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 496us (2952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837866.716409:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 218 00000100:00100000:3.0:1788837866.718874:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837866.719068:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240280320 00000100:00100000:2.0:1788837866.719083:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240280320 00000100:00100000:2.0:1788837866.719259:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 219 00000100:00100000:2.0:1788837866.719272:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a523050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:8147:x1875732240280320:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788837866.719617:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a523050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:8147:x1875732240280320:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 347us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837866.719635:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 219 00000100:00100000:2.0:1788837866.728094:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837866.728888:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240280448 00000100:00100000:1.0:1788837866.728904:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240280448 00000100:00100000:1.0:1788837866.729018:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 220 00000100:00100000:1.0:1788837866.729031:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:8155:x1875732240280448:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788837866.729420:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:8155:x1875732240280448:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 390us (1338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837866.729430:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 220 00000100:00100000:2.0:1788837866.742160:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837866.742310:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240280576 00000100:00100000:1.0:1788837866.742326:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240280576 00000100:00100000:1.0:1788837866.742456:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 221 00000100:00100000:1.0:1788837866.742468:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a520450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:8155:x1875732240280576:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788837866.742838:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a520450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:8155:x1875732240280576:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 371us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837866.742847:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 221 00000100:00100000:3.0:1788837866.751311:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837866.751364:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837866.751603:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240280832 00000100:00100000:0.0:1788837866.751617:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240280832 00000100:00100000:0.0:1788837866.751721:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240280704 00000100:00100000:0.0:1788837866.751725:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240280704 00000100:00100000:0.0:1788837866.751752:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:0.0:1788837866.751956:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2350:x1875732240280832:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788837866.752061:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2350:x1875732240280832:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 299us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837866.752071:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:0.0:1788837866.752096:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:0.0:1788837866.752102:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2348:x1875732240280704:12345-192.168.204.54@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788837866.752134:0:7972:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 1cccdf85-837b-45b2-b451-6b9fb913655f@192.168.204.54@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:0.0:1788837866.752234:0:7972:0:(genops.c:1385:class_connect()) connect: client 1cccdf85-837b-45b2-b451-6b9fb913655f, cookie 0x2deb895b363e63d4 00000004:00100000:0.0:1788837866.752275:0:7972:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788837866.752701:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788837866.753101:0:7972:0:(import.c:65:import_set_state_nolock()) ffff97a448f87000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788837866.753185:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cccdf85-837b-45b2-b451-6b9fb913655f+6:2348:x1875732240280704:12345-192.168.204.54@tcp:38:mount.lustre.0 Request processed in 1080us (1818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837866.753197:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:3.0:1788837866.757964:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837866.758853:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837866.759181:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240280960 00000100:00100000:1.0:1788837866.759195:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240280960 00000100:00100000:1.0:1788837866.759318:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240281088 00000100:00100000:1.0:1788837866.759322:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240281088 00000100:00100000:1.0:1788837866.759363:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:1.0:1788837866.759375:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cccdf85-837b-45b2-b451-6b9fb913655f+7:0:x1875732240280960:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788837866.759437:0:5809:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788837866.759565:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cccdf85-837b-45b2-b451-6b9fb913655f+7:0:x1875732240280960:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 192us (1620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837866.759573:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:1.0:1788837866.759604:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:1.0:1788837866.759611:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cccdf85-837b-45b2-b451-6b9fb913655f+6:8147:x1875732240281088:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788837866.759621:0:5809:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788837866.759664:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cccdf85-837b-45b2-b451-6b9fb913655f+6:8147:x1875732240281088:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 54us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837866.759671:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00080000:2.0:1788837866.760432:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837866.762556:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837866.762783:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240281216 00000100:00100000:1.0:1788837866.762796:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240281216 00000100:00100000:1.0:1788837866.762876:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:1.0:1788837866.762889:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cccdf85-837b-45b2-b451-6b9fb913655f+6:8147:x1875732240281216:12345-192.168.204.54@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788837866.763006:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cccdf85-837b-45b2-b451-6b9fb913655f+6:8147:x1875732240281216:12345-192.168.204.54@tcp:40:mount.lustre.0 Request processed in 119us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837866.763014:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:2.0:1788837866.767029:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837866.767081:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837866.767117:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837866.767254:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240281344 00000100:00100000:0.0:1788837866.767269:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240281344 00000100:00100000:0.0:1788837866.767320:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240281472 00000100:00100000:0.0:1788837866.767324:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240281472 00000100:00100000:0.0:1788837866.767362:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:0.0:1788837866.767374:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1875732240281344:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788837866.767421:0:6682:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1cccdf85-837b-45b2-b451-6b9fb913655f@192.168.204.54@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:0.0:1788837866.767467:0:6682:0:(genops.c:1385:class_connect()) connect: client 1cccdf85-837b-45b2-b451-6b9fb913655f, cookie 0x2deb895b363e63db 00002000:00100000:0.0:1788837866.767482:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1cccdf85-837b-45b2-b451-6b9fb913655f/ffff97a344b34000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113975 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788837866.767513:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788837866.767821:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788837866.767875:0:6682:0:(import.c:65:import_set_state_nolock()) ffff97a344b34800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788837866.767967:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cccdf85-837b-45b2-b451-6b9fb913655f+6:2348:x1875732240281344:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 595us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837866.767976:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:0.0:1788837866.768000:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:0.0:1788837866.768004:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1875732240281472:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788837866.768020:0:6682:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1cccdf85-837b-45b2-b451-6b9fb913655f@192.168.204.54@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:0.0:1788837866.768037:0:6682:0:(genops.c:1385:class_connect()) connect: client 1cccdf85-837b-45b2-b451-6b9fb913655f, cookie 0x2deb895b363e63e2 00002000:00100000:0.0:1788837866.768061:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1cccdf85-837b-45b2-b451-6b9fb913655f/ffff97a344b30800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113975 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788837866.768068:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788837866.768247:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788837866.768265:0:6682:0:(import.c:65:import_set_state_nolock()) ffff97a344b30000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788837866.768290:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cccdf85-837b-45b2-b451-6b9fb913655f+6:2348:x1875732240281472:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 284us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837866.768298:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:3.0:1788837866.769551:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240281600 00000100:00100000:3.0:1788837866.769577:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240281600 00000100:00100000:3.0:1788837866.769788:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:3.0:1788837866.769800:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cccdf85-837b-45b2-b451-6b9fb913655f+6:8147:x1875732240281600:12345-192.168.204.54@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788837866.769911:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788837866.770021:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cccdf85-837b-45b2-b451-6b9fb913655f+6:8147:x1875732240281600:12345-192.168.204.54@tcp:33:mount.lustre.0 Request processed in 224us (2903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837866.770029:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00010000:00010000:0.0:1788837867.044196:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788837867.218200:0:5830:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1cccdf85-837b-45b2-b451-6b9fb913655f 00010000:00010000:0.0:1788837868.066498:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837869.092373:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837869.218454:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788837869.218508:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459204700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254994048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837869.218623:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837869.218830:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254994048 00000100:00100000:1.0:1788837869.218840:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254994048 00000100:00100000:1.0:1788837869.218927:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788837869.218938:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a34735b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254994048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788837869.218983:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837869.219039:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a34735b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254994048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837869.219047:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1788837869.219052:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788837869.219095:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a459204700 x1875732254994048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837885 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837869.219118:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459204700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254994048:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788837870.117098:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837870.755388:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788837870.755416:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254994688:0@lo:400:kworker.0 00000100:00100000:1.0:1788837870.755443:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3272:1875732254994432:0@lo:400:kworker.0 00000100:00100000:0.0:1788837870.755531:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254994304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837870.765408:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837870.765548:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3274:1875732254994560:0@lo:400:kworker.0 00000100:00100000:3.0:1788837870.765642:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837870.765717:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254994560 00000100:00100000:3.0:1788837870.765728:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254994560 00000100:00100000:0.0:1788837870.765802:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837870.765812:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788837870.765824:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1875732254994560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837870.765840:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459204700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732254994176:0@lo:400:kworker.0 00000100:00100000:0.0:1788837870.765875:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837870.765902:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1875732254994560:12345-0@lo:400:kworker.0 Request processed in 80us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837870.765902:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ec3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732254994816:0@lo:400:kworker.0 00000100:00100000:3.0:1788837870.765910:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788837870.765926:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837870.766019:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254994688 00000100:00100000:2.0:1788837870.766025:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254994688 00000100:00100000:2.0:1788837870.766080:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788837870.766088:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254994688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837870.766129:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254994688:12345-0@lo:400:kworker.0 Request processed in 43us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837870.766135:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788837870.768875:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837870.769101:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837870.771385:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254994816 00000100:00100000:3.0:1788837870.771406:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254994816 00000100:00100000:3.0:1788837870.771646:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788837870.771661:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a347358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1875732254994816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837870.771796:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a347358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1875732254994816:12345-0@lo:400:kworker.0 Request processed in 138us (5867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837870.771804:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:3.0:1788837870.771893:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a450ad1880 x1875732254994688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837870.771911:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254994688:0@lo:400:kworker.0 00000100:00100000:3.0:1788837870.771928:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3274:1875732254994560:0@lo:400:kworker.0 00000100:00100000:1.0:1788837870.773869:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ec3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254994944:0@lo:400:kworker.0 00000100:00100000:3.0:1788837870.773943:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254994432 00000100:00100000:3.0:1788837870.773957:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254994432 00000100:00100000:1.0:1788837870.773982:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837870.774021:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788837870.774032:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1875732254994432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837870.774046:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254994944 00000100:00100000:1.0:1788837870.774051:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254994944 00000100:00100000:3.0:1788837870.774585:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1875732254994432:12345-0@lo:400:kworker.0 Request processed in 544us (5478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837870.774607:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788837870.778098:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254994304 00000100:00100000:0.0:1788837870.778124:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254994304 00000100:00100000:0.0:1788837870.778249:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788837870.778274:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a347359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3271:x1875732254994304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788837870.778330:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788837870.779001:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788837870.779022:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837870.779359:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254994176 00000100:00100000:3.0:1788837870.779371:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254994176 00000100:00100000:3.0:1788837870.779514:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788837870.779528:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a520c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3271:x1875732254994176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837870.779823:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788837870.779839:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3272:x1875732254994944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837870.782466:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a520c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3271:x1875732254994176:12345-0@lo:400:kworker.0 Request processed in 2925us (16571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837870.782485:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788837870.782853:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3272:x1875732254994944:12345-0@lo:400:kworker.0 Request processed in 3018us (8867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837870.782865:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788837870.782951:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3272:1875732254994432:0@lo:400:kworker.0 00010000:00080000:1.0:1788837870.782973:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a46ec3c380 x1875732254994944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837870.782985:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ec3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254994944:0@lo:400:kworker.0 00000100:00100000:1.0:1788837870.783070:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459204700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732254994176:0@lo:400:kworker.0 00000100:00100000:1.0:1788837870.783086:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ec3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732254994816:0@lo:400:kworker.0 00000100:00100000:0.0:1788837870.790896:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a347359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254994304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 12612us (25080us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837870.790938:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1788837870.791130:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a46f4b8000 x1875732254994304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837870.791167:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254994304:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788837871.139988:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788837871.372572:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1cccdf85-837b-45b2-b451-6b9fb913655f 00000100:00100000:0.0:1788837871.818774:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837871.818835:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837871.818907:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837871.818938:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837871.818967:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837871.819004:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240281984 00000100:00100000:0.0:1788837871.819017:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240281984 00000100:00100000:0.0:1788837871.819092:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240281856 00000100:00100000:0.0:1788837871.819095:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240281856 00000100:00100000:0.0:1788837871.819124:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:0.0:1788837871.819137:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a34735a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2352:x1875732240281984:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788837871.819296:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a34735a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2352:x1875732240281984:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 160us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837871.819304:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:0.0:1788837871.819325:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:0.0:1788837871.819332:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2352:x1875732240281856:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788837871.819359:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2352:x1875732240281856:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 28us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837871.819366:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:0.0:1788837871.819388:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240282240 00000100:00100000:0.0:1788837871.819392:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240282240 00000100:00100000:0.0:1788837871.819423:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240282112 00000100:00100000:0.0:1788837871.819427:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240282112 00000100:00100000:0.0:1788837871.819452:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:0.0:1788837871.819459:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cccdf85-837b-45b2-b451-6b9fb913655f+6:2352:x1875732240282240:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788837871.819499:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cccdf85-837b-45b2-b451-6b9fb913655f+6:2352:x1875732240282240:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 41us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837871.819509:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:0.0:1788837871.819522:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:0.0:1788837871.819528:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2352:x1875732240282112:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788837871.819554:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2352:x1875732240282112:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 27us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837871.819561:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00080000:0.0:1788837871.819587:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788837871.819592:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788837871.819595:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837871.823099:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240281728 00000100:00100000:3.0:1788837871.823122:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240281728 00000100:00100000:3.0:1788837871.823259:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 223 00000100:00100000:3.0:1788837871.823272:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a521850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2352:x1875732240281728:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788837871.823395:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a521850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2352:x1875732240281728:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 126us (4637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837871.823403:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 223 00000001:00100000:1.0:1788837871.869645:0:7611:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1cccdf85-837b-45b2-b451-6b9fb913655f 00010000:00010000:1.0:1788837872.165625:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788837873.045130:0:10289:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1788837873.199117:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837874.215814:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837874.342700:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254995072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837874.342801:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837874.342905:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254995072 00000100:00100000:2.0:1788837874.342915:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254995072 00000100:00100000:2.0:1788837874.342990:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788837874.343001:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254995072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837874.343047:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837874.343110:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254995072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837874.343119:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1788837874.343145:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788837874.343196:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a4496e2300 x1875732254995072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837874.343243:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254995072:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788837875.236288:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837875.874990:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732254995456:0@lo:400:kworker.0 00000100:00100000:1.0:1788837875.875621:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837875.875958:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ec3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254995200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837875.879710:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254995968:0@lo:400:kworker.0 00000100:00100000:1.0:1788837875.879805:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837875.879867:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788837875.879882:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732254995584:0@lo:400:kworker.0 00000100:00100000:1.0:1788837875.879912:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837875.879971:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254995712:0@lo:400:kworker.0 00000100:00100000:1.0:1788837875.880002:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837875.880052:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254995456 00000100:00100000:1.0:1788837875.880063:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254995456 00000100:00100000:1.0:1788837875.880129:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254995584 00000100:00100000:1.0:1788837875.880132:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254995584 00000100:00100000:1.0:1788837875.880192:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788837875.880230:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732254995456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837875.880320:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732254995456:12345-0@lo:400:kworker.0 Request processed in 120us (4703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837875.880328:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788837875.880351:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788837875.880358:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732254995584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837875.880387:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732254995584:12345-0@lo:400:kworker.0 Request processed in 30us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837875.880637:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788837875.880736:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837875.881164:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3274:1875732254995328:0@lo:400:kworker.0 00000100:00100000:0.0:1788837875.881242:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837875.881268:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3274:1875732254995840:0@lo:400:kworker.0 00000100:00100000:0.0:1788837875.881298:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837875.883999:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254995840 00000100:00100000:0.0:1788837875.884033:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254995840 00000100:00100000:0.0:1788837875.884139:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788837875.884151:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1875732254995840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837875.884312:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1875732254995840:12345-0@lo:400:kworker.0 Request processed in 162us (3011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837875.885320:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1788837875.885912:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837875.885988:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3274:1875732254995840:0@lo:400:kworker.0 00000100:00100000:0.0:1788837875.886293:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254995328 00000100:00100000:0.0:1788837875.886304:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254995328 00000100:00100000:0.0:1788837875.886933:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788837875.886946:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a522c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3274:x1875732254995328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837875.889282:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a522c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3274:x1875732254995328:12345-0@lo:400:kworker.0 Request processed in 2324us (8025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837875.889300:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788837875.891104:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254995968 00000100:00100000:2.0:1788837875.891139:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254995968 00000100:00100000:0.0:1788837875.891250:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732254995584:0@lo:400:kworker.0 00000100:00100000:2.0:1788837875.891261:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254995712 00000100:00100000:2.0:1788837875.891267:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254995712 00000100:00100000:0.0:1788837875.891274:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732254995456:0@lo:400:kworker.0 00000100:00100000:2.0:1788837875.891322:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788837875.891331:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3274:1875732254995328:0@lo:400:kworker.0 00000100:00100000:2.0:1788837875.891765:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254995968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837875.891986:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254995968:12345-0@lo:400:kworker.0 Request processed in 654us (12180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837875.891996:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788837875.892082:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788837875.892090:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254995712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837875.892200:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254995712:12345-0@lo:400:kworker.0 Request processed in 111us (12198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837875.892233:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788837875.892262:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254995200 00000100:00100000:2.0:1788837875.892267:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254995200 00000100:00100000:2.0:1788837875.892601:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788837875.892612:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254995200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788837875.892652:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837875.892704:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254995200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (11968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837875.892729:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1788837875.893236:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a4496e1880 x1875732254995712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837875.893254:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254995712:0@lo:400:kworker.0 00000100:00080000:2.0:1788837875.893370:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788837875.894571:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a46ec3d500 x1875732254995200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837891 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837875.894604:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ec3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254995200:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788837875.894878:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a4496e0700 x1875732254995968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837875.894891:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254995968:0@lo:400:kworker.0 00010000:00010000:1.0:1788837876.274903:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837876.942372:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837876.942415:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837876.942443:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837876.942814:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837876.942849:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837876.942878:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240282624 00000100:00100000:1.0:1788837876.942904:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240282624 00000100:00100000:1.0:1788837876.942960:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240282496 00000100:00100000:1.0:1788837876.942964:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240282496 00000100:00100000:1.0:1788837876.942992:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:1.0:1788837876.943003:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2350:x1875732240282624:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788837876.943090:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2350:x1875732240282624:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 90us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837876.943098:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:1.0:1788837876.943119:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:1.0:1788837876.943125:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2350:x1875732240282496:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788837876.943163:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2350:x1875732240282496:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 38us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837876.943170:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:1.0:1788837876.943189:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240282880 00000100:00100000:1.0:1788837876.943193:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240282880 00000100:00100000:1.0:1788837876.943242:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240282752 00000100:00100000:1.0:1788837876.943246:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240282752 00000100:00100000:1.0:1788837876.943266:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:1.0:1788837876.943273:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2350:x1875732240282880:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788837876.943299:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2350:x1875732240282880:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 27us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837876.943306:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:3.0:1788837876.943587:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240282368 00000100:00100000:3.0:1788837876.943593:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240282368 00000100:00100000:3.0:1788837876.943632:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 225 00000100:00100000:3.0:1788837876.943639:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2350:x1875732240282368:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788837876.943666:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2350:x1875732240282368:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 29us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837876.943672:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 225 00000100:00100000:1.0:1788837876.944623:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:1.0:1788837876.944642:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2350:x1875732240282752:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788837876.944685:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2350:x1875732240282752:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 53us (1835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837876.944706:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00080000:1.0:1788837876.944743:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788837876.944748:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788837876.944751:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788837877.286766:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837878.309385:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837879.330583:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837879.458480:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837879.458515:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254996096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837879.458587:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837879.458704:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254996096 00000100:00100000:2.0:1788837879.458713:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254996096 00000100:00100000:2.0:1788837879.458788:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788837879.458797:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254996096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837879.458837:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837879.458884:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254996096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837879.458891:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788837879.459028:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a4496e1880 x1875732254996096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837879.459048:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254996096:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788837879.459581:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788837880.363636:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837880.995548:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837880.995580:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254996224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837880.995675:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837880.995887:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254996224 00000100:00100000:0.0:1788837880.995900:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254996224 00000100:00100000:0.0:1788837880.995984:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788837880.995997:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254996224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788837880.996049:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837880.996125:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254996224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837880.996134:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1788837880.996191:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a4496e2a00 x1875732254996224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837896 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837880.996235:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254996224:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788837880.996323:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837880.996481:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732254996480:0@lo:400:kworker.0 00000100:00100000:2.0:1788837880.996585:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254996736:0@lo:400:kworker.0 00000100:00100000:2.0:1788837880.996623:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837880.996654:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788837880.996660:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732254996352:0@lo:400:kworker.0 00000100:00100000:1.0:1788837880.996666:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254996736 00000100:00100000:1.0:1788837880.996672:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254996736 00000100:00100000:2.0:1788837880.996691:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837880.996713:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788837880.996721:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254996736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837880.996724:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732254996864:0@lo:400:kworker.0 00000100:00100000:2.0:1788837880.996751:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788837880.996777:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a450ad1c00 x1875732254996736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837880.996786:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254996736:0@lo:400:kworker.0 00000100:00100000:1.0:1788837880.996833:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254996736:12345-0@lo:400:kworker.0 Request processed in 112us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837880.996841:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788837880.996844:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837880.996869:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254996864 00000100:00100000:1.0:1788837880.996874:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254996864 00000100:00100000:3.0:1788837880.996875:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837880.996880:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732254996608:0@lo:400:kworker.0 00000100:00100000:1.0:1788837880.996908:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254996480 00000100:00100000:1.0:1788837880.996912:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254996480 00000100:00100000:3.0:1788837880.996922:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837880.996928:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254996608 00000100:00100000:1.0:1788837880.996931:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254996608 00000100:00100000:3.0:1788837880.996978:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788837880.996987:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1875732254996864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837880.997027:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1875732254996864:12345-0@lo:400:kworker.0 Request processed in 42us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837880.997034:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788837880.997047:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788837880.997053:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732254996480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837880.997098:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732254996480:12345-0@lo:400:kworker.0 Request processed in 45us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837880.997103:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1788837880.997118:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837880.997138:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732254996864:0@lo:400:kworker.0 00000100:00100000:3.0:1788837880.997164:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732254996480:0@lo:400:kworker.0 00000100:00100000:1.0:1788837880.997168:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788837880.997176:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732254996608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837880.997236:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732254996608:12345-0@lo:400:kworker.0 Request processed in 62us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837880.997250:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732254996608:0@lo:400:kworker.0 00000100:00100000:0.0:1788837880.997369:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254996352 00000100:00100000:0.0:1788837880.997374:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254996352 00000100:00100000:1.0:1788837880.997393:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788837880.997412:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788837880.997419:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3273:x1875732254996352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837880.997464:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3273:x1875732254996352:12345-0@lo:400:kworker.0 Request processed in 46us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837880.997471:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788837880.997614:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732254996352:0@lo:400:kworker.0 00010000:00010000:1.0:1788837881.381537:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837882.059972:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837882.060028:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837882.060077:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837882.060102:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837882.060131:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837882.060184:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240283264 00000100:00100000:0.0:1788837882.060199:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240283264 00000100:00100000:0.0:1788837882.060293:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240283136 00000100:00100000:0.0:1788837882.060309:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240283136 00000100:00100000:0.0:1788837882.060354:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 82 00000100:00100000:3.0:1788837882.060424:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240283520 00000100:00100000:3.0:1788837882.060435:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240283520 00000100:00100000:3.0:1788837882.060477:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240283392 00000100:00100000:1.0:1788837882.060477:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240283008 00000100:00100000:3.0:1788837882.060484:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240283392 00000100:00100000:1.0:1788837882.060484:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240283008 00000100:00100000:3.0:1788837882.060511:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:3.0:1788837882.060523:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2349:x1875732240283520:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788837882.060543:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 227 00000100:00100000:1.0:1788837882.060554:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2349:x1875732240283008:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788837882.060640:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2349:x1875732240283008:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 88us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837882.060649:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 227 00000100:00100000:0.0:1788837882.060856:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2349:x1875732240283264:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788837882.063057:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2349:x1875732240283520:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 2503us (2945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837882.063079:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:3.0:1788837882.063134:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:3.0:1788837882.063150:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2349:x1875732240283392:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788837882.063237:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2349:x1875732240283392:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 92us (3104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837882.063243:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:3.0:1788837882.063281:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 83 00000100:00100000:3.0:1788837882.063291:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2349:x1875732240283136:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788837882.063325:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2349:x1875732240283136:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 36us (3222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837882.063331:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 83 00000100:00080000:3.0:1788837882.068334:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788837882.068346:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788837882.068350:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837882.069990:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2349:x1875732240283264:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 9607us (9942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837882.070011:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 82 00010000:00010000:1.0:1788837882.406199:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837883.426329:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837884.454241:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837884.578449:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788837884.578485:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4601bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254996992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837884.578602:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837884.578697:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254996992 00000100:00100000:0.0:1788837884.578708:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254996992 00000100:00100000:0.0:1788837884.578799:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788837884.578812:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732254996992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788837884.578859:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837884.578913:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732254996992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837884.578920:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1788837884.578971:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a4601bc000 x1875732254996992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837884.579006:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4601bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254996992:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788837884.579275:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788837885.474671:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837886.114804:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254997120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837886.114928:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837886.115054:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254997120 00000100:00100000:2.0:1788837886.115062:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254997120 00000100:00100000:2.0:1788837886.115135:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788837886.115144:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732254997120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788837886.115181:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837886.115266:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732254997120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837886.115273:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1788837886.115327:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a4496e0700 x1875732254997120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837902 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837886.115345:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254997120:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788837886.115612:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837886.117479:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254997632:0@lo:400:kworker.0 00000100:00100000:2.0:1788837886.117577:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837886.117615:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788837886.117621:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3272:1875732254997504:0@lo:400:kworker.0 00000100:00100000:2.0:1788837886.117646:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837886.117938:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732254997248:0@lo:400:kworker.0 00000100:00100000:3.0:1788837886.117985:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837886.118011:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732254997760:0@lo:400:kworker.0 00000100:00100000:3.0:1788837886.118032:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837886.118058:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837886.118064:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732254997376:0@lo:400:kworker.0 00000100:00100000:3.0:1788837886.118106:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837886.118143:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254997632 00000100:00100000:3.0:1788837886.118150:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254997632 00000100:00100000:3.0:1788837886.118226:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788837886.118236:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732254997632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837886.118381:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254997504 00000100:00100000:1.0:1788837886.118387:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254997504 00000100:00100000:1.0:1788837886.118416:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254997760 00000100:00100000:1.0:1788837886.118418:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254997760 00000100:00100000:1.0:1788837886.118438:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254997376 00000100:00100000:1.0:1788837886.118440:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254997376 00000100:00100000:1.0:1788837886.118453:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788837886.118460:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1875732254997504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837886.118531:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254997248 00000100:00100000:2.0:1788837886.118535:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254997248 00000100:00100000:2.0:1788837886.118562:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788837886.118575:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3273:x1875732254997248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837886.120331:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788837886.120353:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1875732254997760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837886.120457:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732254997632:12345-0@lo:400:kworker.0 Request processed in 2222us (2878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837886.120467:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788837886.120508:0:5808:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788837886.120516:0:5808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:3.0:1788837886.120620:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788837886.120628:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788837886.120669:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a4496e3800 x1875732254997632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837886.120689:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254997632:0@lo:400:kworker.0 00000100:00100000:3.0:1788837886.120736:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788837886.120744:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732254997376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837886.121068:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1875732254997504:12345-0@lo:400:kworker.0 Request processed in 2607us (3419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837886.121077:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788837886.121127:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3272:1875732254997504:0@lo:400:kworker.0 00000100:00100000:2.0:1788837886.122616:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3273:x1875732254997248:12345-0@lo:400:kworker.0 Request processed in 4033us (4621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837886.122630:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788837886.123575:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732254997248:0@lo:400:kworker.0 00000100:00100000:0.0:1788837886.123736:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1875732254997760:12345-0@lo:400:kworker.0 Request processed in 3391us (5701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837886.123747:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788837886.123899:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732254997760:0@lo:400:kworker.0 00000100:00100000:3.0:1788837886.124852:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732254997376:12345-0@lo:400:kworker.0 Request processed in 4103us (6739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837886.124864:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788837886.124927:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732254997376:0@lo:400:kworker.0 00010000:00010000:0.0:1788837886.499703:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837887.179575:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837887.179649:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837887.179748:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837887.179786:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240283776 00000100:00100000:1.0:1788837887.179798:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240283776 00000100:00100000:1.0:1788837887.179872:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:1.0:1788837887.179884:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2351:x1875732240283776:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788837887.179991:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2351:x1875732240283776:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 109us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837887.180000:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:1.0:1788837887.180027:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240284032 00000100:00100000:1.0:1788837887.180031:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240284032 00000100:00100000:1.0:1788837887.180065:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:1.0:1788837887.180073:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b188c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2348:x1875732240284032:12345-192.168.204.54@tcp:9:kworker.0 00000020:00000080:1.0:1788837887.180097:0:6682:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e63db 00000100:00080000:1.0:1788837887.180109:0:6682:0:(import.c:65:import_set_state_nolock()) ffff97a344b34800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788837887.180159:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788837887.182462:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b188c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cccdf85-837b-45b2-b451-6b9fb913655f+2:2348:x1875732240284032:12345-192.168.204.54@tcp:9:kworker.0 Request processed in 2378us (2701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837887.182477:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00080000:1.0:1788837887.182739:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788837887.182745:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788837887.183172:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837887.183798:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240283648 00000100:00100000:2.0:1788837887.183817:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240283648 00000100:00100000:2.0:1788837887.183894:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 229 00000100:00100000:2.0:1788837887.183906:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a521c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2351:x1875732240283648:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788837887.184012:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a521c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2351:x1875732240283648:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 108us (4453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837887.184020:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 229 00000100:00100000:1.0:1788837887.197053:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837887.201770:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837887.201905:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240284160 00000100:00100000:2.0:1788837887.201916:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240284160 00000100:00100000:2.0:1788837887.202063:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:2.0:1788837887.202074:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2348:x1875732240284160:12345-192.168.204.54@tcp:9:kworker.0 00000020:00000080:2.0:1788837887.202103:0:6653:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e63e2 00000100:00080000:2.0:1788837887.202113:0:6653:0:(import.c:65:import_set_state_nolock()) ffff97a344b30000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788837887.202149:0:6653:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788837887.202608:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cccdf85-837b-45b2-b451-6b9fb913655f+2:2348:x1875732240284160:12345-192.168.204.54@tcp:9:kworker.0 Request processed in 533us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837887.202617:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00010000:00010000:1.0:1788837887.202765:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788837887.202788:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788837887.208472:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240283904 00000100:00100000:0.0:1788837887.208487:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240283904 00000100:00100000:0.0:1788837887.209629:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 88 00000100:00100000:0.0:1788837887.209643:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2351:x1875732240283904:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788837887.209731:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2351:x1875732240283904:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 91us (12689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837887.209739:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 88 00000100:00080000:2.0:1788837887.210707:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788837887.524579:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837888.546663:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837889.571435:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837889.698717:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837889.698739:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4601bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254997888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837889.698826:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837889.699180:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254997888 00000100:00100000:0.0:1788837889.699189:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254997888 00000100:00100000:0.0:1788837889.699270:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788837889.699280:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254997888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788837889.699312:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837889.699377:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254997888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837889.699384:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1788837889.699487:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788837889.699521:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a4601bc000 x1875732254997888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837889.699540:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4601bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254997888:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788837890.594546:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837891.235381:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732254998272:0@lo:400:kworker.0 00000100:00100000:2.0:1788837891.235484:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837891.235541:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837891.235548:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254998400:0@lo:400:kworker.0 00000100:00100000:2.0:1788837891.235573:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837891.235606:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254998272 00000100:00100000:2.0:1788837891.235614:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254998272 00000100:00100000:2.0:1788837891.235667:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788837891.235677:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1875732254998272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837891.235728:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1875732254998272:12345-0@lo:400:kworker.0 Request processed in 53us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837891.235735:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1788837891.235755:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837891.235785:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732254998272:0@lo:400:kworker.0 00000100:00100000:0.0:1788837891.235876:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732254998016:0@lo:400:kworker.0 00000100:00100000:0.0:1788837891.235911:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837891.235943:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732254998528:0@lo:400:kworker.0 00000100:00100000:0.0:1788837891.235983:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837891.236018:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788837891.236024:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732254998144:0@lo:400:kworker.0 00000100:00100000:0.0:1788837891.236059:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837891.236077:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254998656:0@lo:400:kworker.0 00000100:00100000:0.0:1788837891.236098:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837891.236134:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254998528 00000100:00100000:0.0:1788837891.236138:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254998528 00000100:00100000:0.0:1788837891.236174:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254998144 00000100:00100000:0.0:1788837891.236178:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254998144 00000100:00100000:0.0:1788837891.236196:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788837891.236225:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1875732254998528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837891.236262:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1875732254998528:12345-0@lo:400:kworker.0 Request processed in 60us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837891.236269:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788837891.236283:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788837891.236289:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732254998144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837891.236316:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732254998144:12345-0@lo:400:kworker.0 Request processed in 28us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837891.236321:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1788837891.236338:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837891.236357:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732254998144:0@lo:400:kworker.0 00000100:00100000:0.0:1788837891.236367:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732254998528:0@lo:400:kworker.0 00000100:00100000:1.0:1788837891.236717:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837891.236726:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ec3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254998784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837891.236755:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837891.236779:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254998400 00000100:00100000:1.0:1788837891.236783:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254998400 00000100:00100000:1.0:1788837891.236812:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254998656 00000100:00100000:1.0:1788837891.236814:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254998656 00000100:00100000:1.0:1788837891.236856:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788837891.236875:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254998400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837891.236908:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732254998400:12345-0@lo:400:kworker.0 Request processed in 35us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837891.236914:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788837891.236928:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788837891.236934:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254998656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837891.236959:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732254998656:12345-0@lo:400:kworker.0 Request processed in 25us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837891.237101:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788837891.237664:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254998016 00000100:00100000:2.0:1788837891.237670:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254998016 00000100:00100000:2.0:1788837891.237706:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788837891.237713:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a520850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3271:x1875732254998016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837891.237751:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a520850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3271:x1875732254998016:12345-0@lo:400:kworker.0 Request processed in 39us (1839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837891.237758:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788837891.237893:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254998784 00000100:00100000:0.0:1788837891.237897:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254998784 00000100:00100000:0.0:1788837891.237933:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788837891.237941:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254998784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788837891.237983:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837891.238030:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254998784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837891.238037:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788837891.238064:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788837891.238068:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788837891.238111:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a44a40f100 x1875732254998400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837891.238124:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732254998400:0@lo:400:kworker.0 00010000:00080000:0.0:1788837891.238153:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a44a40d180 x1875732254998656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837891.238161:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732254998656:0@lo:400:kworker.0 00000100:00100000:0.0:1788837891.238170:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732254998016:0@lo:400:kworker.0 00010000:00080000:2.0:1788837891.238323:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a46ec3e300 x1875732254998784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837907 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837891.238350:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ec3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254998784:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788837891.618527:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788837891.860335:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1cccdf85-837b-45b2-b451-6b9fb913655f 00000020:00000080:3.0:1788837891.860345:0:6676:0:(genops.c:885:class_export_put()) final put ffff97a344b34000/1cccdf85-837b-45b2-b451-6b9fb913655f 00000020:00000080:3.0:1788837891.860375:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97a344b34000/1cccdf85-837b-45b2-b451-6b9fb913655f for lustre-OST0000 00000020:00000080:3.0:1788837891.860419:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a344b34800 for lustre-OST0000 00000100:00100000:1.0:1788837892.300622:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837892.300658:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837892.300687:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837892.300714:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240284544 00000100:00100000:1.0:1788837892.300723:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240284544 00000100:00100000:1.0:1788837892.300775:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240284416 00000100:00100000:1.0:1788837892.300779:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240284416 00000100:00100000:1.0:1788837892.300802:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 92 00000100:00100000:1.0:1788837892.300812:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2350:x1875732240284544:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788837892.300905:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2350:x1875732240284544:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 94us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837892.300913:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 92 00000100:00100000:1.0:1788837892.300929:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 93 00000100:00100000:1.0:1788837892.300936:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2350:x1875732240284416:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788837892.300959:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2350:x1875732240284416:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 24us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837892.300965:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 93 00000100:00080000:1.0:1788837892.300980:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837892.301989:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240284288 00000100:00100000:2.0:1788837892.301998:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240284288 00000100:00100000:2.0:1788837892.302042:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 231 00000100:00100000:2.0:1788837892.302051:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a522850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2350:x1875732240284288:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788837892.302101:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a522850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2350:x1875732240284288:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 52us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837892.302109:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 231 00000001:00100000:3.0:1788837892.340576:0:7611:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1cccdf85-837b-45b2-b451-6b9fb913655f 00000020:00000080:3.0:1788837892.340587:0:7611:0:(genops.c:885:class_export_put()) final put ffff97a344b30800/1cccdf85-837b-45b2-b451-6b9fb913655f 00000020:00000080:2.0:1788837892.340672:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a344b30800/1cccdf85-837b-45b2-b451-6b9fb913655f for lustre-OST0001 00000020:00000080:2.0:1788837892.340725:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a344b30000 for lustre-OST0001 00010000:00010000:0.0:1788837892.646701:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788837893.023040:0:10995:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788837893.666649:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837894.691566:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837894.820934:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ec3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254998912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837894.821008:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837894.821250:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254998912 00000100:00100000:3.0:1788837894.821258:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254998912 00000100:00100000:3.0:1788837894.821318:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788837894.821327:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254998912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788837894.821363:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788837894.821411:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732254998912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837894.821417:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1788837894.821439:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788837894.821619:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a46ec3ea00 x1875732254998912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837894.821637:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ec3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732254998912:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788837895.720988:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837896.354777:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837896.355062:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ec3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254999040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837896.355449:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837896.355753:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254999040 00000100:00100000:0.0:1788837896.355773:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254999040 00000100:00100000:0.0:1788837896.355854:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788837896.355865:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732254999040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788837896.355934:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837896.355991:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732254999040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837896.355998:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1788837896.356018:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788837896.356196:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a46ec3ed80 x1875732254999040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837896.356365:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ec3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254999040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837896.357257:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47fc55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732254999168:0@lo:400:kworker.0 00000100:00100000:1.0:1788837896.357323:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837896.357386:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837896.357401:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47fc57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254999552:0@lo:400:kworker.0 00000100:00100000:0.0:1788837896.357422:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837896.357442:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47fc54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732254999296:0@lo:400:kworker.0 00000100:00100000:1.0:1788837896.357442:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837896.357443:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47fc54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732254999680:0@lo:400:kworker.0 00000100:00100000:1.0:1788837896.357500:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254999168 00000100:00100000:1.0:1788837896.357508:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254999168 00000100:00100000:0.0:1788837896.357518:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837896.357545:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47fc56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3274:1875732254999424:0@lo:400:kworker.0 00000100:00100000:0.0:1788837896.357580:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254999680 00000100:00100000:0.0:1788837896.357587:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254999680 00000100:00100000:3.0:1788837896.357588:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837896.357659:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254999424 00000100:00100000:0.0:1788837896.357664:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254999424 00000100:00100000:3.0:1788837896.357671:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788837896.357688:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1875732254999680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837896.357716:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788837896.357733:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1875732254999424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837896.357771:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1875732254999680:12345-0@lo:400:kworker.0 Request processed in 74us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837896.357822:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1875732254999424:12345-0@lo:400:kworker.0 Request processed in 94us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837896.357827:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788837896.357842:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1788837896.357892:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837896.357909:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47fc54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732254999680:0@lo:400:kworker.0 00000100:00100000:0.0:1788837896.357929:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837896.357982:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254999296 00000100:00100000:0.0:1788837896.358008:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47fc56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3274:1875732254999424:0@lo:400:kworker.0 00000100:00100000:1.0:1788837896.358225:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788837896.358240:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3272:x1875732254999168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837896.358287:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3272:x1875732254999168:12345-0@lo:400:kworker.0 Request processed in 49us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837896.358291:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254999296 00000100:00100000:1.0:1788837896.358298:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788837896.358346:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47fc55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732254999168:0@lo:400:kworker.0 00000100:00100000:3.0:1788837896.358355:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788837896.358369:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732254999296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837896.358424:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732254999296:12345-0@lo:400:kworker.0 Request processed in 61us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837896.358430:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788837896.358479:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254999552 00000100:00100000:0.0:1788837896.358484:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47fc54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732254999296:0@lo:400:kworker.0 00000100:00100000:3.0:1788837896.358486:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254999552 00000100:00100000:3.0:1788837896.358555:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788837896.358564:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732254999552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837896.358612:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732254999552:12345-0@lo:400:kworker.0 Request processed in 50us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837896.358618:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1788837896.358645:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788837896.358664:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a47fc57100 x1875732254999552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837896.358677:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47fc57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732254999552:0@lo:400:kworker.0 00010000:00010000:0.0:1788837896.740242:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837897.414990:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837897.415041:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837897.415093:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837897.415126:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240284928 00000100:00100000:1.0:1788837897.415136:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240284928 00000100:00100000:1.0:1788837897.415193:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240284800 00000100:00100000:1.0:1788837897.415196:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240284800 00000100:00100000:1.0:1788837897.415247:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 97 00000100:00100000:1.0:1788837897.415256:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2349:x1875732240284928:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788837897.415331:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2349:x1875732240284928:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 75us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837897.415339:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 97 00000100:00100000:1.0:1788837897.415358:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 98 00000100:00100000:1.0:1788837897.415365:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2349:x1875732240284800:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788837897.415390:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2349:x1875732240284800:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 26us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837897.415396:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 98 00000100:00080000:1.0:1788837897.415412:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837897.417658:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240284672 00000100:00100000:2.0:1788837897.417674:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240284672 00000100:00100000:2.0:1788837897.417752:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 233 00000100:00100000:2.0:1788837897.417762:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a523c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2349:x1875732240284672:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788837897.417882:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a523c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2349:x1875732240284672:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 121us (2901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837897.417890:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 233 00000020:00000080:1.0:1788837897.489964:0:11144:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe385336b0 20000000:00000080:1.0:1788837897.489981:0:11144:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97a46e79c400 uarg=0000000000000000 20000000:01000000:1.0:1788837897.490021:0:11144:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788837897.490027:0:11144:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788837897.490032:0:11144:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788837897.500032:0:11145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1788837897.500566:0:11144:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788837897.527527:0:11144:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788837897.529496:0:11144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a458d3d800/0x2deb895b363e63e9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837897.529522:0:11144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a47bbb5200/0x2deb895b363e638e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf13 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837897.529533:0:11144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a458d3ce00/0x2deb895b363e639c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e6395 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837897.529542:0:11144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a44a48ac00/0x2deb895b363e63aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e63a3 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837897.529549:0:11144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a44a48b600/0x2deb895b363e63b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e63b1 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837897.529556:0:11144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a47bbb4200/0x2deb895b363e63cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf4b expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837897.529564:0:11144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a458d3d800/0x2deb895b363e63e9 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837897.529612:0:11144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a47bbb4200/0x2deb895b363e63cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf4b expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837897.529630:0:11144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a47bbb4200/0x2deb895b363e63cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf4b expref: 12 pid: 5802 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837897.531489:0:11144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ec3e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11144:1875732254999808:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788837897.531670:0:11144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a44a48b600/0x2deb895b363e63b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e63b1 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837897.531684:0:11144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a44a48b600/0x2deb895b363e63b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e63b1 expref: 18 pid: 5803 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837897.531698:0:11144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ec3d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11144:1875732254999936:0@lo:104: 00000100:00100000:1.0:1788837897.531756:0:11144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788837897.531796:0:11144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a44a48ac00/0x2deb895b363e63aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e63a3 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837897.531805:0:11144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a44a48ac00/0x2deb895b363e63aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e63a3 expref: 18 pid: 5800 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837897.531813:0:11144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ead0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11144:1875732255000064:0@lo:104: 00000100:00100000:1.0:1788837897.531833:0:11144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788837897.531860:0:11144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a458d3ce00/0x2deb895b363e639c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e6395 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837897.531868:0:11144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a458d3ce00/0x2deb895b363e639c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e6395 expref: 18 pid: 5802 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837897.531875:0:11144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ead1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11144:1875732255000192:0@lo:104: 00000100:00100000:1.0:1788837897.531896:0:11144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788837897.531913:0:11144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a47bbb5200/0x2deb895b363e638e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf13 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837897.531935:0:11144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a47bbb5200/0x2deb895b363e638e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf13 expref: 12 pid: 5803 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837897.531957:0:11144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a409180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11144:1875732255000320:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788837897.531987:0:11144:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448e42480 going to sleep for 11 seconds 00000100:00100000:3.0:1788837897.532251:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732254999936 00000100:00100000:3.0:1788837897.532260:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732254999936 00000100:00100000:3.0:1788837897.532299:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255000064 00000100:00100000:3.0:1788837897.532301:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255000064 00000100:00100000:3.0:1788837897.532310:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255000192 00000100:00100000:3.0:1788837897.532312:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255000192 00000100:00100000:3.0:1788837897.532326:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788837897.532335:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+5:11144:x1875732254999936:12345-0@lo:104: 00010000:00010000:3.0:1788837897.532348:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4000/0x2deb895b363e63b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e63b8 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837897.532410:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788837897.532416:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+5:11144:x1875732254999936:12345-0@lo:104: Request processed in 83us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837897.532422:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788837897.532442:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788837897.532448:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+4:11144:x1875732255000064:12345-0@lo:104: 00010000:00010000:3.0:1788837897.532454:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e63a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e63aa expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837897.532485:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788837897.532491:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+4:11144:x1875732255000064:12345-0@lo:104: Request processed in 44us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837897.532506:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788837897.532519:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788837897.532524:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+3:11144:x1875732255000192:12345-0@lo:104: 00010000:00010000:3.0:1788837897.532531:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a458d3c400/0x2deb895b363e6395 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e639c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837897.532560:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788837897.532564:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+3:11144:x1875732255000192:12345-0@lo:104: Request processed in 41us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837897.532569:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1788837897.532970:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788837897.532978:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4000/0x2deb895b363e63b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e63b8 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837897.532985:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4000 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:1.0:1788837897.532989:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4000/0x2deb895b363e63b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e63b8 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837897.532998:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4000/0x2deb895b363e63b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e63b8 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837897.533005:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4000/0x2deb895b363e63b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e63b8 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837897.533011:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788837897.533047:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4000/0x2deb895b363e63b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e63b8 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837897.533053:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788837897.533288:0:11144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ec3d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11144:1875732254999936:0@lo:104: 00000100:00100000:3.0:1788837897.533299:0:11144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ead0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11144:1875732255000064:0@lo:104: 00000100:00100000:3.0:1788837897.533306:0:11144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ead1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11144:1875732255000192:0@lo:104: 00010000:00010000:3.0:1788837897.533326:0:7597:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788837897.533331:0:7597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e63a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e63aa expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837897.533338:0:7597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48a000 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:3.0:1788837897.533341:0:7597:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e63a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e63aa expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837897.533348:0:7597:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e63a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e63aa expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837897.533354:0:7597:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e63a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e63aa expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837897.533373:0:7597:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788837897.533390:0:7597:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e63a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e63aa expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837897.533395:0:7597:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837897.533486:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4000/0x2deb895b363e63b1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e63b8 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837897.533494:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4000/0x2deb895b363e63b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e63b8 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837897.533506:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837897.533509:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a458d3c400/0x2deb895b363e6395 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e639c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837897.533520:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3c400 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:1.0:1788837897.533523:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a458d3c400/0x2deb895b363e6395 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e639c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837897.533529:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a458d3c400/0x2deb895b363e6395 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e639c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837897.533535:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a458d3c400/0x2deb895b363e6395 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e639c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837897.533540:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788837897.533555:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a458d3c400/0x2deb895b363e6395 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e639c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837897.533560:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837897.533573:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a458d3c400/0x2deb895b363e6395 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e639c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837897.533580:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a458d3c400/0x2deb895b363e6395 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e639c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837897.533589:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837897.533590:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837897.533592:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837897.533603:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732255000704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788837897.533657:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837897.533757:0:7599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255000704 00000100:00100000:1.0:1788837897.533763:0:7599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255000704 00010000:00010000:1.0:1788837897.533787:0:7599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a458d3ce00/0x2deb895b363e639c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e6395 expref: 19 pid: 5802 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837897.533823:0:7599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788837897.533831:0:7599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4497d5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3271:x1875732255000704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788837897.533843:0:7599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837897.533848:0:7599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a458d3ce00/0x2deb895b363e639c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e6395 expref: 19 pid: 5802 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837897.533858:0:7599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a458d3ce00/0x2deb895b363e639c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e6395 expref: 19 pid: 5802 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837897.533872:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a458d3ce00/0x2deb895b363e639c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e6395 expref: 19 pid: 5802 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837897.533883:0:7599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837897.533914:0:7599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4497d5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:3271:x1875732255000704:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837897.533934:0:7599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788837897.533989:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732255000704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837897.534049:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732255000448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837897.534094:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788837897.534312:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837897.534323:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47fc54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3274:1875732255000576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837897.534350:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837897.534381:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255000448 00000100:00100000:0.0:1788837897.534386:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255000448 00010000:00010000:0.0:1788837897.534401:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a44a48b600/0x2deb895b363e63b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e63b1 expref: 18 pid: 5803 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837897.534418:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255000576 00000100:00100000:0.0:1788837897.534421:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255000576 00010000:00010000:0.0:1788837897.534431:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a44a48ac00/0x2deb895b363e63aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e63a3 expref: 19 pid: 5800 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837897.534445:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788837897.534459:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3273:x1875732255000448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837897.534467:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837897.534471:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a44a48b600/0x2deb895b363e63b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e63b1 expref: 19 pid: 5803 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837897.534479:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a44a48b600/0x2deb895b363e63b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e63b1 expref: 19 pid: 5803 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837897.534489:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a44a48b600/0x2deb895b363e63b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e63b1 expref: 19 pid: 5803 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837897.534498:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837897.535090:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788837897.535103:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:3274:x1875732255000576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788837897.535112:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837897.535117:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a44a48ac00/0x2deb895b363e63aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e63a3 expref: 18 pid: 5800 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837897.535127:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a44a48ac00/0x2deb895b363e63aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e63a3 expref: 18 pid: 5800 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837897.535138:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a44a48ac00/0x2deb895b363e63aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e63a3 expref: 18 pid: 5800 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837897.535156:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837897.535192:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:3274:x1875732255000576:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837897.535198:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788837897.538416:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47fc54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3274:1875732255000576:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788837897.550371:0:7597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e63a3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e63aa expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837897.550392:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e63a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e63aa expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837897.550420:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837897.550423:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837897.550426:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837897.550721:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837897.550764:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837897.550816:0:11144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ec3e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11144:1875732254999808:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788837897.550826:0:11144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a409180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11144:1875732255000320:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788837897.550866:0:11144:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a458d3d800/0x2deb895b363e63e9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837897.550904:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240285056 00000100:00100000:3.0:1788837897.550911:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240285056 00010000:00010000:3.0:1788837897.551024:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a47bbb4200/0x2deb895b363e63cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf4b expref: 13 pid: 5802 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837897.551051:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240285184 00000100:00100000:3.0:1788837897.551054:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240285184 00010000:00010000:3.0:1788837897.551136:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a47bbb5200/0x2deb895b363e638e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf13 expref: 14 pid: 5803 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837897.551170:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:3.0:1788837897.551180:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+14:2352:x1875732240285056:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837897.551397:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837897.551404:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a47bbb4200/0x2deb895b363e63cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf4b expref: 14 pid: 5802 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837897.551417:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a47bbb4200/0x2deb895b363e63cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf4b expref: 14 pid: 5802 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837897.551434:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a47bbb4200/0x2deb895b363e63cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf4b expref: 14 pid: 5802 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837897.551449:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837897.551501:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2352:x1875732240285056:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 323us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837897.551508:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:3.0:1788837897.551529:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:3.0:1788837897.551534:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+12:2352:x1875732240285184:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837897.551541:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837897.551545:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a47bbb5200/0x2deb895b363e638e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf13 expref: 12 pid: 5803 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837897.551553:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a47bbb5200/0x2deb895b363e638e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf13 expref: 12 pid: 5803 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837897.551562:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a47bbb5200/0x2deb895b363e638e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf13 expref: 12 pid: 5803 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837897.551579:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a458d3d800/0x2deb895b363e63e9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837897.551586:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a458d3d800/0x2deb895b363e63e9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837897.551599:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a458d3d800/0x2deb895b363e63e9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837897.551605:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a458d3d800/0x2deb895b363e63e9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837897.551611:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a458d3d800/0x2deb895b363e63e9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837897.551616:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a458d3d800/0x2deb895b363e63e9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837897.551622:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3d800 already unused, calling callback (ffffffffc1616420) 00010000:00010000:3.0:1788837897.551625:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a458d3d800/0x2deb895b363e63e9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837897.551632:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a458d3d800/0x2deb895b363e63e9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837897.551643:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a458d3d800/0x2deb895b363e63e9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837897.551664:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837897.551682:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+11:2352:x1875732240285184:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 148us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837897.551693:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 29 00010000:00010000:3.0:1788837897.553664:0:11144:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97a458d3d800/0x2deb895b363e63e9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837897.553683:0:11144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a458d3d800/0x2deb895b363e63e9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837897.553689:0:11144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a458d3d800/0x2deb895b363e63e9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837897.555236:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:3273:x1875732255000448:12345-0@lo:103:ldlm_bl.0 Request processed in 20767us (21130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837897.555248:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788837897.558236:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732255000448:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788837897.779990:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837898.787330:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837899.080651:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837899.080738:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240285312 00000100:00100000:1.0:1788837899.080749:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240285312 00000100:00100000:1.0:1788837899.080805:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 234 00000100:00100000:1.0:1788837899.080816:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+11:5591:x1875732240285312:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837899.080833:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837899.080856:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a458d3c400/0x2deb895b363e63f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0cf75 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837899.080886:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a458d3c400/0x2deb895b363e63f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf75 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837899.080910:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a458d3c400/0x2deb895b363e63f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf75 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837899.080919:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3c400, rc 0) 00000100:00100000:1.0:1788837899.080982:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+12:5591:x1875732240285312:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 167us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837899.080990:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 234 00000100:00100000:2.0:1788837899.084190:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837899.084394:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240285440 00000100:00100000:1.0:1788837899.084431:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240285440 00000100:00100000:1.0:1788837899.084498:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 235 00000100:00100000:1.0:1788837899.084511:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+12:5591:x1875732240285440:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837899.084829:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+12:5591:x1875732240285440:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 320us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837899.084838:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 235 00000100:00100000:0.0:1788837899.088511:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837899.088658:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240285568 00000100:00100000:1.0:1788837899.088669:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240285568 00000100:00100000:1.0:1788837899.088743:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 236 00000100:00100000:1.0:1788837899.088753:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+12:5591:x1875732240285568:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837899.089704:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+12:5591:x1875732240285568:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 945us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837899.089725:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 236 00000100:00100000:3.0:1788837899.099039:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837899.099146:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240285696 00000100:00100000:1.0:1788837899.099162:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240285696 00000100:00100000:1.0:1788837899.099279:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 237 00000100:00100000:1.0:1788837899.099291:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+12:5591:x1875732240285696:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837899.099308:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837899.099329:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a458d3d200/0x2deb895b363e63f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0cf7c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837899.099360:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a458d3d200/0x2deb895b363e63f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf7c expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837899.099371:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a458d3d200/0x2deb895b363e63f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf7c expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837899.099401:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3d200, rc 0) 00000100:00100000:1.0:1788837899.099638:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:5591:x1875732240285696:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 348us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837899.099645:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 237 00000100:00100000:0.0:1788837899.108756:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837899.109731:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240285824 00000100:00100000:1.0:1788837899.109747:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240285824 00000100:00100000:1.0:1788837899.109831:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 238 00000100:00100000:1.0:1788837899.109854:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:5591:x1875732240285824:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837899.110938:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:5591:x1875732240285824:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 1088us (2190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837899.110951:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 238 00000100:00100000:0.0:1788837899.113424:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837899.113582:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240285952 00000100:00100000:3.0:1788837899.113596:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240285952 00000100:00100000:3.0:1788837899.113662:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 239 00000100:00100000:3.0:1788837899.113674:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:5591:x1875732240285952:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837899.113992:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:5591:x1875732240285952:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 320us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837899.114001:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 239 10000000:01000000:3.0:1788837899.298398:0:5805:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788837899.298410:0:5805:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a3451f4000 from 7 10000000:01000000:3.0:1788837899.298416:0:5805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788837899.298479:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e63fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837899.298495:0:5805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e63fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837899.298508:0:5805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e63fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837899.299164:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47fc55f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255000832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837899.299300:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837899.299374:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f9f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788837899.299643:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255000832 00000100:00100000:2.0:1788837899.299653:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255000832 00000100:00100000:2.0:1788837899.299728:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788837899.299739:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:5805:x1875732255000832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837899.299757:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837899.299776:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a47bbb5000/0x2deb895b363e6405 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e63fe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837899.299809:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a47bbb5000/0x2deb895b363e6405 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e63fe expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837899.299822:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a47bbb5000/0x2deb895b363e6405 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e63fe expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837899.299831:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5000, rc 0) 00000100:00100000:2.0:1788837899.299896:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:5805:x1875732255000832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837899.299907:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788837899.300093:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47fc55f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255000832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837899.300113:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e63fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6405 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837899.300124:0:5805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e63fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e6405 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837899.300541:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4601bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255000960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837899.300588:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837899.300630:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a46e8eb180 going to sleep for 11 seconds 00000100:00100000:3.0:1788837899.300884:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255000960 00000100:00100000:3.0:1788837899.300892:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255000960 00000100:00100000:3.0:1788837899.300933:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788837899.300945:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:5805:x1875732255000960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837899.301304:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:5805:x1875732255000960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 359us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837899.301315:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788837899.301442:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4601bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255000960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837899.301490:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4601bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255001088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837899.301540:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837899.301578:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a46e8eb180 going to sleep for 11 seconds 00000100:00100000:3.0:1788837899.301626:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255001088 00000100:00100000:3.0:1788837899.301632:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255001088 00000100:00100000:3.0:1788837899.301672:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788837899.301680:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:5805:x1875732255001088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837899.301895:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:5805:x1875732255001088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837899.301903:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788837899.302262:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4601bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255001088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788837899.303315:0:11194:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788837899.304364:0:5805:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788837899.304415:0:5805:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788837899.304429:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e63fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6405 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837899.304442:0:5805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e63fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6405 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837899.304455:0:5805:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788837899.304458:0:5805:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a448f86800 from 7 10000000:01000000:0.0:1788837899.304462:0:5805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788837899.304507:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a46e790000/0x2deb895b363e640c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837899.304516:0:5805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a46e790000/0x2deb895b363e640c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837899.304529:0:5805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a46e790000/0x2deb895b363e640c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837899.304557:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4601bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255001216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788837899.304640:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837899.304716:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a46e8eb180 going to sleep for 11 seconds 00000100:00100000:1.0:1788837899.304744:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255001216 00000100:00100000:1.0:1788837899.304754:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255001216 00000100:00100000:1.0:1788837899.304813:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788837899.304824:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:5805:x1875732255001216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837899.304840:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837899.304855:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a458d3c800/0x2deb895b363e6413 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e640c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837899.304884:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a458d3c800/0x2deb895b363e6413 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e640c expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837899.304897:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a458d3c800/0x2deb895b363e6413 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e640c expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837899.304908:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3c800, rc 0) 00000100:00100000:1.0:1788837899.304965:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:5805:x1875732255001216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837899.304973:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788837899.305003:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4601bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255001216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837899.305021:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a46e790000/0x2deb895b363e640c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6413 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837899.305031:0:5805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a46e790000/0x2deb895b363e640c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e6413 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837899.305098:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4601bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255001344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837899.305167:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837899.305254:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255001344 00000100:00100000:0.0:1788837899.305255:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a46e8eb180 going to sleep for 11 seconds 00000100:00100000:1.0:1788837899.305260:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255001344 00000100:00100000:1.0:1788837899.305294:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788837899.305301:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:5805:x1875732255001344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837899.305596:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:5805:x1875732255001344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 294us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837899.305604:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788837899.305624:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4601bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255001344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837899.305659:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4601bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255001472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837899.305719:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837899.305740:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a46e8eb180 going to sleep for 11 seconds 00000100:00100000:1.0:1788837899.306373:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255001472 00000100:00100000:1.0:1788837899.306381:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255001472 00000100:00100000:1.0:1788837899.306433:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788837899.306442:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:5805:x1875732255001472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837899.307158:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:5805:x1875732255001472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 715us (1436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837899.307170:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788837899.307230:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4601bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255001472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788837899.308986:0:11195:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788837899.309164:0:5805:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788837899.309192:0:5805:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788837899.309265:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a46e790000/0x2deb895b363e640c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6413 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837899.309279:0:5805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a46e790000/0x2deb895b363e640c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6413 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837899.309307:0:5805:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788837899.309310:0:5805:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a448c63800 from 7 10000000:01000000:3.0:1788837899.309313:0:5805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788837899.309358:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48aa00/0x2deb895b363e641a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837899.309367:0:5805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a44a48aa00/0x2deb895b363e641a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837899.309378:0:5805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a44a48aa00/0x2deb895b363e641a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837899.309514:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47fc57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255001600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837899.309605:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837899.309656:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f9f240 going to sleep for 11 seconds 00000100:00100000:1.0:1788837899.309814:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255001600 00000100:00100000:1.0:1788837899.309823:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255001600 00000100:00100000:1.0:1788837899.309902:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788837899.309914:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:5805:x1875732255001600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837899.309932:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837899.309961:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a458d3dc00/0x2deb895b363e6421 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e641a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837899.309998:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a458d3dc00/0x2deb895b363e6421 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e641a expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837899.310024:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a458d3dc00/0x2deb895b363e6421 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e641a expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837899.310034:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3dc00, rc 0) 00000100:00100000:1.0:1788837899.310091:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:5805:x1875732255001600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837899.310099:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788837899.310274:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47fc57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255001600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837899.310294:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a44a48aa00/0x2deb895b363e641a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6421 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837899.310307:0:5805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a44a48aa00/0x2deb895b363e641a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e6421 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837899.310374:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4601bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255001728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837899.310405:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837899.310435:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a46e8eba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788837899.310871:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255001728 00000100:00100000:1.0:1788837899.310888:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255001728 00000100:00100000:1.0:1788837899.310935:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788837899.310944:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:5805:x1875732255001728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837899.311330:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:5805:x1875732255001728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 387us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837899.311339:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788837899.311688:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4601bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255001728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837899.311752:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4601bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255001856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837899.311811:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837899.311856:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a46e8eba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837899.312324:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255001856 00000100:00100000:3.0:1788837899.312333:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255001856 00000100:00100000:3.0:1788837899.312377:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788837899.312387:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:5805:x1875732255001856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837899.312627:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:5805:x1875732255001856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 240us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837899.312635:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788837899.312842:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4601bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255001856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788837899.318147:0:11196:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788837899.318779:0:5805:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788837899.318811:0:5805:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788837899.318826:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48aa00/0x2deb895b363e641a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6421 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837899.318842:0:5805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a44a48aa00/0x2deb895b363e641a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6421 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837899.812959:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837899.951345:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788837899.951367:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255001984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837899.951434:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837899.951472:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255001984 00000100:00100000:0.0:1788837899.951480:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255001984 00000100:00100000:0.0:1788837899.951542:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788837899.951552:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255001984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788837899.951585:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837899.951634:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255001984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837899.951641:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1788837899.951661:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788837899.951701:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a44a40aa00 x1875732255001984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837899.951721:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255001984:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788837900.834603:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837901.474987:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837901.475011:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255002112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837901.475084:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837901.475150:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255002112 00000100:00100000:1.0:1788837901.475156:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255002112 00000100:00100000:1.0:1788837901.475238:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788837901.475250:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732255002112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837901.475287:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837901.475341:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732255002112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837901.475347:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1788837901.475368:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788837901.475399:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a44a409c00 x1875732255002112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837901.475417:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255002112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837901.485569:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255002624:0@lo:400:kworker.0 00000100:00100000:1.0:1788837901.485655:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837901.485716:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788837901.485722:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732255002240:0@lo:400:kworker.0 00000100:00100000:1.0:1788837901.485749:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837901.485782:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732255002752:0@lo:400:kworker.0 00000100:00100000:1.0:1788837901.485808:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837901.485836:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732255002368:0@lo:400:kworker.0 00000100:00100000:1.0:1788837901.485858:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837901.486012:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788837901.486020:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732255002496:0@lo:400:kworker.0 00000100:00100000:1.0:1788837901.486045:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837901.486079:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255002624 00000100:00100000:1.0:1788837901.486086:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255002624 00000100:00100000:1.0:1788837901.486145:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788837901.486155:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255002624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837901.486238:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255002624:12345-0@lo:400:kworker.0 Request processed in 85us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837901.486246:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788837901.486286:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255002240 00000100:00100000:1.0:1788837901.486290:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255002240 00000100:00100000:1.0:1788837901.486315:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788837901.486321:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3273:x1875732255002240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837901.486351:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3273:x1875732255002240:12345-0@lo:400:kworker.0 Request processed in 30us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837901.486357:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788837901.486384:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255002752 00000100:00100000:1.0:1788837901.486387:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255002752 00000100:00100000:1.0:1788837901.486410:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255002368 00000100:00100000:1.0:1788837901.486413:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255002368 00000100:00100000:1.0:1788837901.486427:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255002496 00000100:00100000:1.0:1788837901.486429:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255002496 00000100:00100000:1.0:1788837901.486444:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788837901.486449:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1875732255002752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837901.486479:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1875732255002752:12345-0@lo:400:kworker.0 Request processed in 29us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837901.486486:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788837901.486499:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788837901.486505:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732255002368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837901.486537:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732255002368:12345-0@lo:400:kworker.0 Request processed in 32us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837901.486542:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788837901.486553:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788837901.486557:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732255002496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837901.486579:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732255002496:12345-0@lo:400:kworker.0 Request processed in 22us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837901.486594:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:1.0:1788837901.486628:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837901.486633:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837901.486672:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732255002496:0@lo:400:kworker.0 00000100:00100000:1.0:1788837901.486685:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732255002368:0@lo:400:kworker.0 00000100:00100000:1.0:1788837901.486712:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732255002240:0@lo:400:kworker.0 00000100:00100000:1.0:1788837901.486721:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732255002752:0@lo:400:kworker.0 00010000:00080000:1.0:1788837901.486732:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a44a40b100 x1875732255002624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837901.486742:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255002624:0@lo:400:kworker.0 00000001:02000400:1.0:1788837901.718807:0:11340:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788837901.859165:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837902.554289:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837902.554394:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837902.554450:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837902.554550:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240286336 00000100:00100000:2.0:1788837902.554560:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240286336 00000100:00100000:2.0:1788837902.554628:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240286208 00000100:00100000:2.0:1788837902.554631:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240286208 00000100:00100000:2.0:1788837902.554670:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 102 00000100:00100000:2.0:1788837902.554681:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2350:x1875732240286336:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788837902.554779:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2350:x1875732240286336:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 100us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837902.554798:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 102 00000100:00100000:2.0:1788837902.554816:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 103 00000100:00100000:2.0:1788837902.554834:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2350:x1875732240286208:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788837902.554859:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2350:x1875732240286208:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 38us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837902.554865:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 103 00000100:00080000:3.0:1788837902.557731:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837902.558628:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240286080 00000100:00100000:1.0:1788837902.558651:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240286080 00000100:00100000:1.0:1788837902.559352:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 250 00000100:00100000:1.0:1788837902.559364:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2350:x1875732240286080:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788837902.559449:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2350:x1875732240286080:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 88us (5325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837902.559457:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 250 00010000:00010000:1.0:1788837902.882660:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837903.906607:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837904.930916:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837905.071324:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788837905.071360:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255002880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837905.071461:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837905.071619:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255002880 00000100:00100000:0.0:1788837905.071630:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255002880 00000100:00100000:0.0:1788837905.071708:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788837905.071720:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255002880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788837905.071774:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837905.071847:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255002880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837905.071871:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1788837905.071930:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a46e7d4700 x1875732255002880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837921 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837905.071953:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255002880:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788837905.073272:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788837905.958114:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837906.595168:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788837906.595226:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255003008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837906.595325:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837906.595426:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255003008 00000100:00100000:1.0:1788837906.595436:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255003008 00000100:00100000:1.0:1788837906.595513:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788837906.595524:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255003008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837906.595581:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837906.595630:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255003008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837906.595638:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1788837906.595665:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788837906.595717:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a46e7d7b80 x1875732255003008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837906.595737:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255003008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837906.596278:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255003520:0@lo:400:kworker.0 00000100:00100000:2.0:1788837906.596319:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837906.596345:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788837906.596351:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3272:1875732255003392:0@lo:400:kworker.0 00000100:00100000:2.0:1788837906.596379:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837906.596405:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255003520 00000100:00100000:2.0:1788837906.596410:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255003520 00000100:00100000:2.0:1788837906.596449:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788837906.596457:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255003520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837906.596499:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255003520:12345-0@lo:400:kworker.0 Request processed in 43us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837906.596506:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1788837906.596541:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a44a40dc00 x1875732255003520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837906.596552:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255003520:0@lo:400:kworker.0 00000100:00100000:0.0:1788837906.596624:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3274:1875732255003264:0@lo:400:kworker.0 00000100:00100000:0.0:1788837906.596658:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837906.596687:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788837906.596692:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3274:1875732255003136:0@lo:400:kworker.0 00000100:00100000:0.0:1788837906.596722:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837906.596746:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3274:1875732255003648:0@lo:400:kworker.0 00000100:00100000:0.0:1788837906.596767:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837906.597120:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255003392 00000100:00100000:2.0:1788837906.597126:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255003392 00000100:00100000:2.0:1788837906.597185:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255003264 00000100:00100000:2.0:1788837906.597223:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255003264 00000100:00100000:2.0:1788837906.597247:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255003648 00000100:00100000:2.0:1788837906.597251:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255003648 00000100:00100000:2.0:1788837906.597270:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788837906.597276:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1875732255003392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837906.597321:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1875732255003392:12345-0@lo:400:kworker.0 Request processed in 45us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837906.597328:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788837906.597341:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788837906.597347:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1875732255003264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837906.597378:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1875732255003264:12345-0@lo:400:kworker.0 Request processed in 31us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837906.597383:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788837906.597394:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788837906.597400:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1875732255003648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837906.597425:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1875732255003648:12345-0@lo:400:kworker.0 Request processed in 26us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837906.597432:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788837906.597475:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3272:1875732255003392:0@lo:400:kworker.0 00000100:00100000:2.0:1788837906.597505:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3274:1875732255003648:0@lo:400:kworker.0 00000100:00100000:2.0:1788837906.597514:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3274:1875732255003264:0@lo:400:kworker.0 00000100:00080000:0.0:1788837906.597589:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837906.597708:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255003136 00000100:00100000:1.0:1788837906.597713:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255003136 00000100:00100000:1.0:1788837906.597754:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788837906.597761:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4551a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3274:x1875732255003136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837906.597801:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4551a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3274:x1875732255003136:12345-0@lo:400:kworker.0 Request processed in 41us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837906.597807:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788837906.597858:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3274:1875732255003136:0@lo:400:kworker.0 00000001:02000400:2.0:1788837906.969670:0:11441:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 23:25:03 (1788837903) === 00010000:00010000:0.0:1788837906.984565:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837907.305158:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837907.305752:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240286464 00000100:00100000:2.0:1788837907.305766:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240286464 00000100:00100000:2.0:1788837907.305859:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:2.0:1788837907.305884:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2352:x1875732240286464:12345-192.168.204.54@tcp:41:mkdir.0 00000004:00000024:2.0:1788837907.305968:0:10730:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788837907.306101:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2352:x1875732240286464:12345-192.168.204.54@tcp:41:mkdir.0 Request processed in 231us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837907.306109:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00080000:0.0:1788837907.306436:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837907.309885:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837907.310012:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240286592 00000100:00100000:1.0:1788837907.310022:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240286592 00000100:00100000:1.0:1788837907.310084:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:1.0:1788837907.310093:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:9701:x1875732240286592:12345-192.168.204.54@tcp:700:mkdir.0 00000100:00100000:1.0:1788837907.310179:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:9701:x1875732240286592:12345-192.168.204.54@tcp:700:mkdir.0 Request processed in 87us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837907.310245:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:1.0:1788837907.319081:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837907.319177:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240286848 00000100:00100000:2.0:1788837907.319186:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240286848 00000100:00100000:2.0:1788837907.319289:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:2.0:1788837907.319299:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:9701:x1875732240286848:12345-192.168.204.54@tcp:36:mkdir.0 00010000:00010000:2.0:1788837907.319352:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837907.319426:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e6309 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cefe expref: 6 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.319448:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a45487fc00) 00010000:00010000:2.0:1788837907.319457:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837907.319793:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6428 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.319808:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6428 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.319819:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6428 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.319832:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e642f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.319838:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e642f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.319856:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e642f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837907.320939:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788837907.320952:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6428 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.320960:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6428 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.320967:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6428 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.320973:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837907.320979:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6428 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.320986:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6428 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.320999:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a448b3cb00) 00010000:00010000:2.0:1788837907.321002:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837907.321006:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6428 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.321013:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6428 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837907.321029:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0effecb reply state 0000000013a25949 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e642f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837907.321048:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788837907.321152:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:9701:x1875732240286848:12345-192.168.204.54@tcp:36:mkdir.0 Request processed in 1851us (2078us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788837907.321160:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00010000:00010000:1.0:1788837907.325486:0:3257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e642f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.325505:0:3257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e642f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.325514:0:3257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e642f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.325520:0:3257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4000 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837907.325524:0:3257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e642f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.325532:0:3257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e642f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.325560:0:3257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff97a448b3c000) 00010000:00010000:1.0:1788837907.325564:0:3257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837907.325568:0:3257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e642f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.325575:0:3257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e642f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837907.347453:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837907.347591:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240286976 00000100:00100000:2.0:1788837907.347601:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240286976 00000100:00100000:2.0:1788837907.347688:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:2.0:1788837907.347698:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:9702:x1875732240286976:12345-192.168.204.54@tcp:101:chmod.0 00010000:00010000:2.0:1788837907.347718:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837907.347749:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6436 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0cf83 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.347812:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e643d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.347826:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e643d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.347838:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e643d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837907.347869:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788837907.347872:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837907.347918:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e643d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.347944:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6436 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf83 expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.347978:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e643d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf83 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.347986:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a448b3cb00) 00010000:00010000:2.0:1788837907.347989:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788837907.347992:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5e00, rc 0) 00000100:00100000:2.0:1788837907.348053:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:9702:x1875732240286976:12345-192.168.204.54@tcp:101:chmod.0 Request processed in 357us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837907.348061:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:3.0:1788837907.357446:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837907.357711:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240287232 00000100:00100000:2.0:1788837907.357722:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240287232 00000100:00100000:2.0:1788837907.357788:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:2.0:1788837907.357798:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:9702:x1875732240287232:12345-192.168.204.54@tcp:36:chmod.0 00010000:00010000:2.0:1788837907.357851:0:7972:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837907.357876:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e643d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf83 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.357896:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a448b3cb00) 00010000:00010000:2.0:1788837907.357906:0:7972:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837907.357929:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6444 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.357942:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6444 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.357952:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6444 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837907.358985:0:7972:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000db94c49a reply state 0000000062d0e9bd transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6444 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837907.358997:0:7972:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788837907.359005:0:7972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788837907.359664:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:9702:x1875732240287232:12345-192.168.204.54@tcp:36:chmod.0 Request processed in 1863us (2225us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788837907.359673:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00010000:00010000:2.0:1788837907.367139:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6444 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.367158:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6444 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.367166:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6444 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.367172:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837907.367177:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6444 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.367185:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6444 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.367694:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a448b3c500) 00010000:00010000:2.0:1788837907.367699:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788837907.367705:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6444 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.367721:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6444 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837907.418322:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837907.418403:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240287360 00000100:00100000:0.0:1788837907.418414:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240287360 00000100:00100000:0.0:1788837907.418474:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:0.0:1788837907.418484:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:9703:x1875732240287360:12345-192.168.204.54@tcp:101:chown.0 00010000:00010000:0.0:1788837907.418508:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837907.418530:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e644b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0cf8a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837907.418608:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791200/0x2deb895b363e6452 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837907.418633:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791200/0x2deb895b363e6452 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837907.418645:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791200/0x2deb895b363e6452 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837907.418682:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788837907.418685:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788837907.418725:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791200/0x2deb895b363e6452 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837907.418748:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e644b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf8a expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837907.418765:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791200/0x2deb895b363e6452 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf8a expref: 8 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837907.418774:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a462b58700) 00010000:00010000:0.0:1788837907.418777:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788837907.418780:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e791200, rc 0) 00000100:00100000:0.0:1788837907.418835:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:9703:x1875732240287360:12345-192.168.204.54@tcp:101:chown.0 Request processed in 352us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837907.418841:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:3.0:1788837907.422905:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837907.425141:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240287488 00000100:00100000:2.0:1788837907.425159:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240287488 00000100:00100000:2.0:1788837907.425335:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:2.0:1788837907.425349:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:9703:x1875732240287488:12345-192.168.204.54@tcp:101:chown.0 00010000:00010000:2.0:1788837907.425374:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837907.425414:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6459 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0cf91 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.425510:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6460 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.425529:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6460 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.425540:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6460 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.425579:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e6467 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.425588:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e6467 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.425594:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e6467 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.425677:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e646e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.425970:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e646e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.425993:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e646e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837907.426025:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788837907.426029:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837907.426050:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e646e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.426062:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6460 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.426069:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6460 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.426076:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6460 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.426082:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5e00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837907.426086:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6460 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.426093:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6460 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.426106:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a462b58700) 00010000:00010000:2.0:1788837907.426109:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837907.426115:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6460 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.426121:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6460 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.426147:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e6467 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.426154:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e6467 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.426160:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e6467 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.426165:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4800 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837907.426168:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e6467 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.426175:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e6467 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.426183:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff97a448b3c500) 00010000:00010000:2.0:1788837907.426186:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837907.426189:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e6467 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.426194:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e6467 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.426252:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6459 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf91 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.426267:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e646e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf91 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.426285:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97a448b3cb00) 00010000:00010000:2.0:1788837907.426287:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788837907.426290:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5c00, rc 0) 00000100:00100000:2.0:1788837907.426375:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+9:9703:x1875732240287488:12345-192.168.204.54@tcp:101:chown.0 Request processed in 1029us (3479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837907.426383:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:3.0:1788837907.431673:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837907.431860:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240287744 00000100:00100000:2.0:1788837907.431874:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240287744 00000100:00100000:2.0:1788837907.432028:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:2.0:1788837907.432042:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+9:9703:x1875732240287744:12345-192.168.204.54@tcp:36:chown.0 00010000:00010000:2.0:1788837907.432101:0:7972:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837907.432130:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e646e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf91 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.432150:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97a448b3cb00) 00010000:00010000:2.0:1788837907.432160:0:7972:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837907.432184:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6475 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.432197:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6475 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.433027:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6475 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788837907.491361:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1788837907.491616:0:7972:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6f0ccf5 reply state 00000000a211756a transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6475 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837907.491631:0:7972:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788837907.491648:0:7972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:3.0:1788837907.491860:0:7972:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788837907.491950:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:9703:x1875732240287744:12345-192.168.204.54@tcp:36:chown.0 Request processed in 59907us (60282us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788837907.491959:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00010000:00010000:1.0:1788837907.492084:0:3257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6475 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.492109:0:3257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6475 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.492117:0:3257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6475 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.492124:0:3257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837907.492129:0:3257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6475 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.492137:0:3257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6475 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.492153:0:3257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97a448b3c500) 00010000:00010000:1.0:1788837907.492156:0:3257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788837907.492160:0:3257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6475 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.492167:0:3257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6475 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837907.526453:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837907.526875:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240287872 00000100:00100000:0.0:1788837907.526887:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240287872 00000100:00100000:0.0:1788837907.526993:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:0.0:1788837907.527006:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:9704:x1875732240287872:12345-192.168.204.54@tcp:101:touch.500 00010000:00010000:0.0:1788837907.527037:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837907.527074:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e647c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0cf98 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788837907.531998:0:5808:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4867us 00010000:00010000:2.0:1788837907.540145:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6483 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.540176:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6483 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.540189:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6483 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.540231:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e648a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.540239:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e648a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.540247:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e648a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.540726:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6491 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.540737:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.540745:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837907.540768:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788837907.540772:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837907.540809:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.540822:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6483 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.540837:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6483 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.540844:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6483 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.540851:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5c00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837907.540856:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6483 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.540864:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6483 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.540877:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a462b58700) 00010000:00010000:2.0:1788837907.540881:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837907.540886:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6483 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.540892:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6483 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.540903:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e648a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.540909:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e648a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.540914:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e648a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.540920:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4800 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837907.540928:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e648a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.540935:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e648a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.540944:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff97a448b3cb00) 00010000:00010000:2.0:1788837907.540947:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837907.540950:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e648a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.540956:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e648a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.540990:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e647c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf98 expref: 8 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.541005:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6491 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf98 expref: 7 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.541013:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97a448b3ce00) 00010000:00010000:2.0:1788837907.541016:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788837907.541019:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5e00, rc 0) 00000100:00100000:2.0:1788837907.541130:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:9704:x1875732240287872:12345-192.168.204.54@tcp:101:touch.500 Request processed in 14127us (14684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837907.541139:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:3.0:1788837907.545052:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837907.545128:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240288128 00000100:00100000:2.0:1788837907.545139:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240288128 00000100:00100000:2.0:1788837907.545196:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:2.0:1788837907.545254:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:9704:x1875732240288128:12345-192.168.204.54@tcp:101:touch.500 00010000:00010000:2.0:1788837907.545302:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837907.545323:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6498 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0cf9f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.545601:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e649f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.545615:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e649f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.545626:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e649f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.545680:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e64a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.545689:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e64a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.545695:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e64a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788837907.548176:0:5809:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1788837907.549193:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e64ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.549253:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e64ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.549266:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e64ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.549317:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e649f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.549324:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e649f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.549331:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e649f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.549337:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5800 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837907.549342:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e649f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.549350:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e649f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.549363:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97a448b3ce00) 00010000:00010000:2.0:1788837907.549366:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837907.549370:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e649f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.549377:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e649f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837907.549389:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007901d456 reply state 000000009f3256f1 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e64a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837907.549397:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788837907.549433:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6498 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf9f expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.549461:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e64ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf9f expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.549468:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97a448b3cb00) 00010000:00010000:2.0:1788837907.549471:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837907.549473:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4800, rc 0) 00000100:00100000:2.0:1788837907.549560:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+10:9704:x1875732240288128:12345-192.168.204.54@tcp:101:touch.500 Request processed in 4308us (4518us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788837907.549570:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00010000:00010000:1.0:1788837907.552006:0:3257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e64a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.552024:0:3257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e64a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.552032:0:3257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e64a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.552037:0:3257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4400 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837907.552056:0:3257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e64a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.552064:0:3257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e64a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.552079:0:3257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x51ee4c24 (ffff97a448b3c800) 00010000:00010000:1.0:1788837907.552082:0:3257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837907.552085:0:3257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e64a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.552091:0:3257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e64a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837907.553777:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837907.553901:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240288384 00000100:00100000:2.0:1788837907.553910:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240288384 00000100:00100000:2.0:1788837907.554009:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:2.0:1788837907.554021:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+9:9704:x1875732240288384:12345-192.168.204.54@tcp:36:touch.500 00010000:00010000:2.0:1788837907.554095:0:7972:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837907.554126:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e64ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf9f expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.554153:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97a448b3cb00) 00010000:00010000:2.0:1788837907.554164:0:7972:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837907.554263:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e64bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.554281:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e64bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.554302:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e64bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837907.554490:0:7972:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006259231a reply state 0000000025183fc9 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e64bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837907.554500:0:7972:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788837907.554649:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+10:9704:x1875732240288384:12345-192.168.204.54@tcp:36:touch.500 Request processed in 628us (879us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788837907.554656:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00010000:00010000:2.0:1788837907.555998:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e64bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.556011:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e64bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.556017:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e64bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.556023:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5c00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837907.556027:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e64bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.556035:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e64bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.556049:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:2.0:1788837907.556053:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837907.556057:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e64bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.556065:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e64bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837907.557443:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837907.557499:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240288512 00000100:00100000:2.0:1788837907.557509:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240288512 00000100:00100000:2.0:1788837907.557568:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:2.0:1788837907.557577:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+9:9704:x1875732240288512:12345-192.168.204.54@tcp:101:touch.500 00010000:00010000:2.0:1788837907.557600:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837907.557619:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e64c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0cfa6 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.557680:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e64c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cfa6 expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.557695:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e64c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cfa6 expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.557716:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97a448b3c300) 00010000:00010000:2.0:1788837907.557720:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788837907.557723:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4e00, rc 0) 00000100:00100000:2.0:1788837907.557782:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+10:9704:x1875732240288512:12345-192.168.204.54@tcp:101:touch.500 Request processed in 205us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837907.557789:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:0.0:1788837907.563760:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837907.563850:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240288640 00000100:00100000:1.0:1788837907.563860:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240288640 00000100:00100000:1.0:1788837907.563958:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:1.0:1788837907.563967:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1875732240288640:12345-192.168.204.54@tcp:8:touch.500 00010000:00080000:1.0:1788837907.564001:0:6653:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7@192.168.204.54@tcp t0 exp 0000000000000000 cur 287 last 0 00000020:00000080:1.0:1788837907.564031:0:6653:0:(genops.c:1385:class_connect()) connect: client f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7, cookie 0x2deb895b363e64c9 00002000:00100000:1.0:1788837907.564044:0:6653:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7/ffff97a461921800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113975 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788837907.564066:0:6653:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788837907.564336:0:6653:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788837907.564365:0:6653:0:(import.c:65:import_set_state_nolock()) ffff97a449767000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788837907.564432:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2348:x1875732240288640:12345-192.168.204.54@tcp:8:touch.500 Request processed in 464us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837907.564439:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:0.0:1788837907.567838:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837907.567927:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240288768 00000100:00100000:2.0:1788837907.567938:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240288768 00000100:00100000:2.0:1788837907.568006:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:2.0:1788837907.568017:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:0:x1875732240288768:12345-192.168.204.54@tcp:2:touch.500 00000100:00080000:0.0:1788837907.568164:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1788837907.609405:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7 00000001:00080000:3.0:1788837907.609432:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:2.0:1788837907.609519:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:0:x1875732240288768:12345-192.168.204.54@tcp:2:touch.500 Request processed in 41499us (41686us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788837907.609557:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:3.0:1788837907.612554:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837907.612901:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240289024 00000100:00100000:2.0:1788837907.612911:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240289024 00000100:00100000:2.0:1788837907.612971:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:2.0:1788837907.612981:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+10:9704:x1875732240289024:12345-192.168.204.54@tcp:35:touch.500 00000100:00100000:2.0:1788837907.613930:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+11:9704:x1875732240289024:12345-192.168.204.54@tcp:35:touch.500 Request processed in 945us (1390us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788837907.613940:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:0.0:1788837907.626999:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837907.627309:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240289152 00000100:00100000:2.0:1788837907.627321:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240289152 00000100:00100000:2.0:1788837907.627386:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:2.0:1788837907.627397:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+11:9705:x1875732240289152:12345-192.168.204.54@tcp:101:rm.0 00010000:00010000:2.0:1788837907.627422:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837907.627444:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e64d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0cfad expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.627512:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e64d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.627526:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e64d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.627538:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e64d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837907.627584:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788837907.627589:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837907.627633:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e64d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.627666:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e64d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cfad expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.627685:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e64d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cfad expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.627694:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97a448b3ce00) 00010000:00010000:2.0:1788837907.627697:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788837907.627701:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4800, rc 0) 00000100:00100000:2.0:1788837907.627769:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+12:9705:x1875732240289152:12345-192.168.204.54@tcp:101:rm.0 Request processed in 374us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837907.627776:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:0.0:1788837907.634901:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837907.634957:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240289408 00000100:00100000:2.0:1788837907.634968:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240289408 00000100:00100000:2.0:1788837907.635035:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:2.0:1788837907.635048:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+12:9705:x1875732240289408:12345-192.168.204.54@tcp:101:rm.0 00010000:00010000:2.0:1788837907.635071:0:7972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837907.635095:0:7972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e64de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0cfb4 expref: -99 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837907.635194:0:7972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788837907.636201:0:7972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e64de lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cfb4 expref: 14 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.636247:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a462b58700) 00010000:00010000:2.0:1788837907.636269:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788837907.636276:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e64de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cfb4 expref: 14 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.636290:0:7972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5c00, rc 0) 00000100:00100000:2.0:1788837907.636364:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+13:9705:x1875732240289408:12345-192.168.204.54@tcp:101:rm.0 Request processed in 1319us (1475us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1788837907.636372:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:2.0:1788837907.642406:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837907.642465:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240289536 00000100:00100000:0.0:1788837907.642476:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240289536 00000100:00100000:0.0:1788837907.642537:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:0.0:1788837907.642921:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+13:9705:x1875732240289536:12345-192.168.204.54@tcp:37:rm.0 00000100:00100000:2.0:1788837907.648707:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+13:9705:x1875732240289536:12345-192.168.204.54@tcp:37:rm.0 Request processed in 5782us (6305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837907.648720:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:3.0:1788837907.652967:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837907.653195:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240289792 00000100:00100000:2.0:1788837907.653238:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240289792 00000100:00100000:2.0:1788837907.653289:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:2.0:1788837907.653298:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4713ae850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+13:9705:x1875732240289792:12345-192.168.204.54@tcp:35:rm.0 00000100:00100000:2.0:1788837907.653536:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4713ae850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+14:9705:x1875732240289792:12345-192.168.204.54@tcp:35:rm.0 Request processed in 237us (576us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788837907.653553:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:0.0:1788837907.654720:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837907.654754:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837907.654817:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240289920 00000100:00100000:3.0:1788837907.654824:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240289920 00000100:00100000:3.0:1788837907.654867:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 252 00000100:00100000:3.0:1788837907.654875:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4551ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2349:x1875732240289920:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788837907.654933:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4551ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2349:x1875732240289920:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 58us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837907.654939:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 252 00000100:00100000:2.0:1788837907.655012:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240290048 00000100:00100000:2.0:1788837907.655017:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240290048 00000100:00100000:2.0:1788837907.655133:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 107 00000100:00100000:2.0:1788837907.655141:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2349:x1875732240290048:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788837907.655170:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2349:x1875732240290048:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 32us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837907.655177:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 107 00000100:00080000:3.0:1788837907.655399:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837907.655823:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837907.656038:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240290304 00000100:00100000:2.0:1788837907.656044:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240290304 00000100:00100000:2.0:1788837907.656153:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:2.0:1788837907.656161:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+14:9705:x1875732240290304:12345-192.168.204.54@tcp:101:rm.0 00010000:00010000:2.0:1788837907.656182:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837907.656239:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e64ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0cfbb expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.656341:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e64f3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.656356:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e64f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.656369:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e64f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837907.656381:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788837907.656551:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e64ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cfbb expref: 17 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.656571:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e64f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cfbb expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.656581:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97a448b3ce00) 00010000:00010000:2.0:1788837907.656585:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788837907.656589:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5800, rc 0) 00000100:00100000:2.0:1788837907.656634:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+16:9705:x1875732240290304:12345-192.168.204.54@tcp:101:rm.0 Request processed in 474us (814us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788837907.656650:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:0.0:1788837907.660617:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837907.660706:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240290432 00000100:00100000:2.0:1788837907.660715:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240290432 00000100:00100000:2.0:1788837907.660853:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:2.0:1788837907.660864:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+16:9705:x1875732240290432:12345-192.168.204.54@tcp:41:rm.0 00000004:00000024:2.0:1788837907.660938:0:7972:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1788837907.661006:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+16:9705:x1875732240290432:12345-192.168.204.54@tcp:41:rm.0 Request processed in 144us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837907.661013:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:0.0:1788837907.665301:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837907.665392:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240290560 00000100:00100000:2.0:1788837907.665401:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240290560 00000100:00100000:2.0:1788837907.665458:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:2.0:1788837907.665467:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+16:9705:x1875732240290560:12345-192.168.204.54@tcp:101:rm.0 00010000:00010000:2.0:1788837907.665487:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837907.665508:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6501 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0cfc2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.665583:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6508 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.665599:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6508 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.665611:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6508 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.665627:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e650f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.665648:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e650f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.665654:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e650f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.665845:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6516 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.665854:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.665861:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837907.665950:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788837907.665954:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837907.665972:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.665984:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.665992:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6508 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.665998:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6508 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.666006:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6508 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.666021:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4a00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837907.666026:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6508 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.666033:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6508 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.666046:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97a448b3ce00) 00010000:00010000:2.0:1788837907.666049:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837907.666115:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6508 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.666123:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6508 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.666136:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e650f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.666142:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e650f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.666148:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e650f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.666154:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4400 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837907.666156:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e650f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.666162:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e650f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.666179:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x51ee4c24 (ffff97a448b3c400) 00010000:00010000:2.0:1788837907.666181:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837907.666184:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e650f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.666190:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e650f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.666289:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6501 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cfc2 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.666303:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6516 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cfc2 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.666311:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97a448b3c300) 00010000:00010000:2.0:1788837907.666313:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837907.666316:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4200, rc 0) 00000100:00100000:2.0:1788837907.666376:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+17:9705:x1875732240290560:12345-192.168.204.54@tcp:101:rm.0 Request processed in 909us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837907.666384:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:3.0:1788837907.669350:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837907.670085:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240290816 00000100:00100000:1.0:1788837907.670110:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240290816 00000100:00100000:1.0:1788837907.670174:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:1.0:1788837907.670185:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+17:9705:x1875732240290816:12345-192.168.204.54@tcp:36:rm.0 00010000:00010000:1.0:1788837907.670272:0:10730:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788837907.670301:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6516 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cfc2 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.670324:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e64c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cfa6 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.670336:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97a448b3c300) 00010000:00010000:1.0:1788837907.670350:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e64d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cfad expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.670358:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97a448b3ce00) 00010000:00010000:1.0:1788837907.670362:0:10730:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788837907.670382:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e651d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.670401:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e651d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.670411:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e651d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.670425:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e6524 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.670432:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e6524 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.670459:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e6524 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.670610:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c200/0x2deb895b363e652b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.670618:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c200/0x2deb895b363e652b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.670624:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c200/0x2deb895b363e652b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788837907.671360:0:10730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788837907.671372:0:10730:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 287765168582ns, next at 288765166239ns, rc = 0 00010000:00010000:1.0:1788837907.671427:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6532 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.671437:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.671446:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.671453:0:10730:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6532 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.671460:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6532 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.671466:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6532 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.671499:0:10730:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837907.671521:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c200/0x2deb895b363e652b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.671528:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c200/0x2deb895b363e652b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837907.671533:0:7598:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837907.671535:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c200/0x2deb895b363e652b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837907.671540:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6532 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.671555:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3c200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837907.671562:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3ce00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:1.0:1788837907.671564:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c200/0x2deb895b363e652b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837907.671568:0:7598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6532 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.671576:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c200/0x2deb895b363e652b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837907.671579:0:7598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6532 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.671593:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97a45487f000) 00010000:00010000:1.0:1788837907.671598:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788837907.671602:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c200/0x2deb895b363e652b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.671609:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c200/0x2deb895b363e652b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.671626:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e651d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.671632:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e651d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.671647:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e651d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.671652:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3c000 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837907.671655:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e651d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.671661:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e651d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.671669:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97a448b3ce00) 00010000:00010000:1.0:1788837907.671671:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837907.671674:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e651d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.671680:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e651d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788837907.671689:0:10730:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008fa6c82f reply state 000000003642d7a2 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e6524 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837907.671697:0:10730:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788837907.671751:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97a45487f000) 00010000:00010000:0.0:1788837907.671755:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788837907.671766:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6532 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837907.671773:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6532 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837907.671788:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+16:9705:x1875732240290816:12345-192.168.204.54@tcp:36:rm.0 Request processed in 1601us (2444us total) trans 4294967306 rc 0/0 00010000:00010000:0.0:1788837907.671790:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837907.671793:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837907.671798:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837907.671802:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 30 00010000:00010000:1.0:1788837907.673872:0:3257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e6524 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.673889:0:3257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e6524 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.673914:0:3257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e6524 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.673920:0:3257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3de00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837907.673925:0:3257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e6524 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.673932:0:3257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e6524 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.673948:0:3257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x51ee4c24 (ffff97a45487fc00) 00010000:00010000:1.0:1788837907.673951:0:3257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837907.673954:0:3257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e6524 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837907.673961:0:3257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e6524 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837907.676900:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837907.677061:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240291072 00000100:00100000:2.0:1788837907.677071:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240291072 00000100:00100000:2.0:1788837907.677122:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:2.0:1788837907.677132:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+15:9705:x1875732240291072:12345-192.168.204.54@tcp:35:rm.0 00000100:00100000:2.0:1788837907.677379:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+16:9705:x1875732240291072:12345-192.168.204.54@tcp:35:rm.0 Request processed in 248us (489us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788837907.677387:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:0.0:1788837907.680711:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837907.680826:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240291328 00000100:00100000:2.0:1788837907.680835:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240291328 00000100:00100000:2.0:1788837907.680888:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:2.0:1788837907.680898:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+16:9705:x1875732240291328:12345-192.168.204.54@tcp:36:rm.0 00010000:00010000:2.0:1788837907.680950:0:7972:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788837907.680976:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e64f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cfbb expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.680995:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6491 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf98 expref: 15 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.681006:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97a448b3ce00) 00010000:00010000:2.0:1788837907.681019:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791200/0x2deb895b363e6452 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf8a expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.681028:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a462b58700) 00010000:00010000:2.0:1788837907.681034:0:7972:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837907.681059:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6539 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.681071:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6539 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.681080:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6539 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.681092:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6540 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.681099:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6540 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.681553:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6540 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.681886:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6547 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.681897:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6547 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.681904:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6547 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837907.682585:0:7972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788837907.682601:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6547 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.682609:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6547 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.682617:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6547 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.682623:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4a00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837907.682626:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6547 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.682635:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6547 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.682646:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97a448b3cb00) 00010000:00010000:2.0:1788837907.682649:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788837907.682660:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6547 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.682667:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6547 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.682687:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6539 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.682693:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6539 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.682699:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6539 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.682704:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5c00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837907.682707:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6539 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.682712:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6539 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.682718:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a448b3c400) 00010000:00010000:2.0:1788837907.682721:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837907.682885:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6539 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.682893:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6539 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837907.682907:0:7972:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eff402fe reply state 000000004536ad5b transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6540 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837907.682925:0:7972:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788837907.683012:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+15:9705:x1875732240291328:12345-192.168.204.54@tcp:36:rm.0 Request processed in 2113us (2306us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788837907.683021:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 31 00010000:00010000:2.0:1788837907.685137:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6540 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.685153:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6540 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.685161:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6540 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.685167:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4400 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837907.685171:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6540 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.685179:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6540 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.685195:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff97a448b3c900) 00010000:00010000:2.0:1788837907.685198:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837907.685383:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6540 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837907.685391:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6540 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837908.002780:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837909.026689:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837910.054511:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788837910.178417:0:6680:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 290272210938ns, next at 291272208518ns, rc = 0 00000100:00100000:0.0:1788837910.178534:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788837910.178556:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255003776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837910.178630:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837910.178725:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255003776 00000100:00100000:1.0:1788837910.178733:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255003776 00000100:00100000:1.0:1788837910.178829:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788837910.178839:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b662a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255003776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788837910.178875:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837910.178925:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b662a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255003776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837910.178931:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1788837910.178996:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a44a40aa00 x1875732255003776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837926 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837910.179012:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255003776:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788837910.185422:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788837911.075509:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837911.714556:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732255004160:0@lo:400:kworker.0 00000100:00100000:0.0:1788837911.714637:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837911.714701:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788837911.714709:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255004288:0@lo:400:kworker.0 00000100:00100000:0.0:1788837911.714744:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837911.714791:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255004288 00000100:00100000:0.0:1788837911.714799:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255004288 00000100:00100000:0.0:1788837911.714852:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788837911.714861:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255004288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837911.714888:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255004672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837911.714914:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255004288:12345-0@lo:400:kworker.0 Request processed in 53us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837911.714922:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788837911.715027:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788837911.715079:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a47b661500 x1875732255004288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837911.715093:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255004288:0@lo:400:kworker.0 00000100:00100000:2.0:1788837911.715130:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732255003904:0@lo:400:kworker.0 00000100:00100000:2.0:1788837911.715181:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837911.715184:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255004672 00000100:00100000:1.0:1788837911.715189:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255004672 00000100:00100000:2.0:1788837911.715236:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732255004416:0@lo:400:kworker.0 00000100:00100000:3.0:1788837911.715246:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255003904 00000100:00100000:3.0:1788837911.715252:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255003904 00000100:00100000:1.0:1788837911.715254:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788837911.715262:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837911.715264:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255004672:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837911.715285:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788837911.715291:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788837911.715293:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732255004032:0@lo:400:kworker.0 00002000:00000024:1.0:1788837911.715293:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788837911.715303:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4551a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3271:x1875732255003904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837911.715317:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837911.715335:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255004672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837911.715338:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b662680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255004544:0@lo:400:kworker.0 00000100:00100000:1.0:1788837911.715343:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788837911.715350:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4551a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3271:x1875732255003904:12345-0@lo:400:kworker.0 Request processed in 50us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837911.715363:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837911.715367:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788837911.715396:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732255003904:0@lo:400:kworker.0 00010000:00080000:3.0:1788837911.715425:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a44a40aa00 x1875732255004672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837911.715431:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255004160 00000100:00100000:2.0:1788837911.715437:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255004160 00000100:00100000:3.0:1788837911.715444:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255004672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837911.715478:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255004416 00000100:00100000:2.0:1788837911.715482:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255004416 00000100:00100000:2.0:1788837911.715501:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255004032 00000100:00100000:2.0:1788837911.715504:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255004032 00000100:00100000:2.0:1788837911.715517:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788837911.715524:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1875732255004160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837911.715559:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1875732255004160:12345-0@lo:400:kworker.0 Request processed in 36us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837911.715566:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788837911.715578:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788837911.715597:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1875732255004416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837911.715609:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732255004160:0@lo:400:kworker.0 00000100:00100000:2.0:1788837911.715634:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1875732255004416:12345-0@lo:400:kworker.0 Request processed in 37us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837911.715641:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788837911.715653:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788837911.715665:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732255004032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837911.715692:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732255004032:12345-0@lo:400:kworker.0 Request processed in 29us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837911.715698:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788837911.715722:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255004544 00000100:00100000:2.0:1788837911.715726:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255004544 00000100:00100000:2.0:1788837911.715758:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788837911.715764:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255004544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837911.715791:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255004544:12345-0@lo:400:kworker.0 Request processed in 28us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837911.715797:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788837911.715827:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732255004032:0@lo:400:kworker.0 00010000:00080000:2.0:1788837911.715838:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a47b662680 x1875732255004544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837911.715846:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b662680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255004544:0@lo:400:kworker.0 00000100:00100000:2.0:1788837911.715855:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732255004416:0@lo:400:kworker.0 00000100:00080000:0.0:1788837911.718650:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788837911.718673:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:2.0:1788837912.030795:0:11592:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1788837912.100094:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837912.785788:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837912.785849:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837912.786007:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837912.786049:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837912.786302:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240291712 00000100:00100000:0.0:1788837912.786316:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240291712 00000100:00100000:0.0:1788837912.786409:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:0.0:1788837912.786424:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b661180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2349:x1875732240291712:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788837912.786546:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b661180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2349:x1875732240291712:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 123us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837912.786554:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:0.0:1788837912.786593:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240291584 00000100:00100000:0.0:1788837912.786597:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240291584 00000100:00100000:0.0:1788837912.786636:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240291840 00000100:00100000:0.0:1788837912.786640:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240291840 00000100:00100000:0.0:1788837912.786662:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 111 00000100:00100000:0.0:1788837912.786672:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+14:2349:x1875732240291584:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788837912.786716:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+14:2349:x1875732240291584:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 46us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837912.786723:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 111 00000100:00100000:0.0:1788837912.786739:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 112 00000100:00100000:0.0:1788837912.786751:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2349:x1875732240291840:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788837912.787368:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240291456 00000100:00100000:2.0:1788837912.787383:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240291456 00000100:00100000:2.0:1788837912.787456:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 254 00000100:00100000:2.0:1788837912.787468:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a460089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2349:x1875732240291456:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788837912.791136:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a460089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2349:x1875732240291456:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 3655us (5359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837912.791152:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 254 00000100:00100000:0.0:1788837912.792097:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2349:x1875732240291840:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 5335us (6031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837912.792131:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 112 00000100:00080000:0.0:1788837912.792384:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788837912.792393:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788837912.843604:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1788837912.843652:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:1.0:1788837912.843659:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788837912.843667:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:1.0:1788837912.843891:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255004800:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788837912.844005:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837912.844270:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255004800 00000100:00100000:1.0:1788837912.844281:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255004800 00000100:00100000:1.0:1788837912.844368:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788837912.844380:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732255004800:12345-0@lo:6:osp-syn-0-0.0 00000100:00080000:0.0:1788837912.844586:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1788837912.845738:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1788837912.845829:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9f8012, atime: 0x6a9f8012, ctime: 0x6a9f8012, blocks: 0x1 00010000:00010000:1.0:1788837912.845843:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7c4c10e/0x2deb895b363e654e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837912.845871:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=292s v=(0 0) 00010000:00010000:1.0:1788837912.845901:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837912.845912:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7c4c10e/0x2deb895b363e654e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837912.845941:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7c4c10e/0x2deb895b363e654e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837912.845958:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7c4c10e/0x2deb895b363e654e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837912.845968:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7c4c10e/0x2deb895b363e654e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837912.846009:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788837912.846754:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837912.846765:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7c4c10e/0x2deb895b363e654e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837912.846777:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3d600 already unused, calling callback (ffffffffc1616420) 00010000:00010000:2.0:1788837912.846783:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7c4c10e/0x2deb895b363e654e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837912.846795:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7c4c10e/0x2deb895b363e654e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837912.846827:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7c4c10e/0x2deb895b363e654e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837912.846835:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7c4c10e/0x2deb895b363e654e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837912.846862:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837912.846864:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837912.846866:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837912.850094:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3274:x1875732255004800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5699us (6072us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788837912.850116:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:2.0:1788837912.850412:0:3274:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97a44a409c00/2, rc 0, transno 4294967300 00000100:00100000:2.0:1788837912.850423:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255004800:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788837913.122598:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788837913.145272:0:11641:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec8606da0 20000000:00000080:1.0:1788837913.145310:0:11641:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97a46f374800 uarg=0000000000000000 20000000:01000000:1.0:1788837913.145349:0:11641:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788837913.145357:0:11641:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788837913.145362:0:11641:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788837913.151880:0:11642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788837913.152586:0:11641:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788837913.159120:0:11641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788837913.159180:0:11641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788837913.159737:0:11641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788837913.159760:0:11641:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788837913.159780:0:11641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a44a48b200/0x2deb895b363e6555 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.159877:0:11641:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a458d3c400/0x2deb895b363e63f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf75 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.159886:0:11641:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a458d3d200/0x2deb895b363e63f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf7c expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.159895:0:11641:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a47bbb5000/0x2deb895b363e6405 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e63fe expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.159901:0:11641:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a458d3c800/0x2deb895b363e6413 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e640c expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.159908:0:11641:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a458d3dc00/0x2deb895b363e6421 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e641a expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.159928:0:11641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a44a48b200/0x2deb895b363e6555 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.159968:0:11641:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a458d3dc00/0x2deb895b363e6421 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e641a expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.159982:0:11641:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a458d3dc00/0x2deb895b363e6421 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e641a expref: 18 pid: 5800 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837913.159998:0:11641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1875732255004928:0@lo:104: 00000100:00100000:3.0:1788837913.160074:0:11641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788837913.160176:0:11641:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a458d3c800/0x2deb895b363e6413 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e640c expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.160184:0:11641:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a458d3c800/0x2deb895b363e6413 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e640c expref: 18 pid: 5803 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837913.160192:0:11641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1875732255005056:0@lo:104: 00000100:00100000:3.0:1788837913.160238:0:11641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788837913.160425:0:11641:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a47bbb5000/0x2deb895b363e6405 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e63fe expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.160433:0:11641:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a47bbb5000/0x2deb895b363e6405 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e63fe expref: 18 pid: 5800 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837913.160452:0:11641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1875732255005184:0@lo:104: 00000100:00100000:3.0:1788837913.160476:0:11641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837913.160533:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255004928 00000100:00100000:2.0:1788837913.160541:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255004928 00000100:00100000:2.0:1788837913.160576:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255005056 00000100:00100000:2.0:1788837913.160578:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255005056 00000100:00100000:2.0:1788837913.160592:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788837913.160608:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+4:11641:x1875732255004928:12345-0@lo:104: 00010000:00010000:2.0:1788837913.160685:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a44a48aa00/0x2deb895b363e641a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e6421 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.160739:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788837913.160745:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+4:11641:x1875732255004928:12345-0@lo:104: Request processed in 139us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837913.160753:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788837913.160770:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788837913.160778:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+3:11641:x1875732255005056:12345-0@lo:104: 00010000:00010000:2.0:1788837913.160786:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a46e790000/0x2deb895b363e640c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e6413 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.160795:0:7598:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837913.160803:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a44a48aa00/0x2deb895b363e641a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e6421 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.160812:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48aa00 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:1.0:1788837913.160822:0:7598:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a44a48aa00/0x2deb895b363e641a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e6421 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.160831:0:7598:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a44a48aa00/0x2deb895b363e641a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e6421 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.160838:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:1.0:1788837913.160840:0:7598:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a44a48aa00/0x2deb895b363e641a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e6421 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837913.160846:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+3:11641:x1875732255005056:12345-0@lo:104: Request processed in 68us (606us total) trans 0 rc 0/0 10000000:01000000:1.0:1788837913.160852:0:7598:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788837913.160857:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1788837913.160890:0:7598:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a44a48aa00/0x2deb895b363e641a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e6421 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.160897:0:7598:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837913.160935:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a44a48aa00/0x2deb895b363e641a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e6421 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.160942:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a44a48aa00/0x2deb895b363e641a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e6421 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.160954:0:7598:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837913.160958:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a46e790000/0x2deb895b363e640c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e6413 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.160964:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e790000 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:1.0:1788837913.160967:0:7598:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a46e790000/0x2deb895b363e640c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e6413 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.160974:0:7598:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a46e790000/0x2deb895b363e640c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e6413 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837913.160987:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732255005312:0@lo:103:ldlm_bl.0 10000000:00010000:1.0:1788837913.160991:0:7598:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a46e790000/0x2deb895b363e640c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e6413 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837913.160998:0:7598:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788837913.161016:0:7598:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a46e790000/0x2deb895b363e640c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e6413 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837913.161024:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788837913.161029:0:7598:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837913.161037:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a46e790000/0x2deb895b363e640c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e6413 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.161044:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a46e790000/0x2deb895b363e640c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e6413 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.161054:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.161057:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837913.161059:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837913.161067:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732255005440:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788837913.161072:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.161072:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837913.161088:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255005312 00000100:00100000:2.0:1788837913.161090:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837913.161097:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255005312 00000100:00100000:1.0:1788837913.161115:0:7599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255005440 00000100:00100000:1.0:1788837913.161120:0:7599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255005440 00010000:00010000:3.0:1788837913.161122:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a458d3dc00/0x2deb895b363e6421 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e641a expref: 19 pid: 5800 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837913.161127:0:5792:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788837913.161138:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255005184 00000100:00100000:2.0:1788837913.161142:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255005184 00010000:00010000:1.0:1788837913.161143:0:7599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a458d3c800/0x2deb895b363e6413 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e640c expref: 20 pid: 5803 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837913.161148:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788837913.161158:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+20:3271:x1875732255005312:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837913.161162:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788837913.161167:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e733850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+3:11641:x1875732255005184:12345-0@lo:104: 00010000:00010000:3.0:1788837913.161169:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837913.161175:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a458d3dc00/0x2deb895b363e6421 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e641a expref: 20 pid: 5800 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837913.161177:0:7599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1788837913.161184:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e63fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e6405 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837913.161192:0:7599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e394dacb-3a10-4fe7-bf6d-0294b37a120d+20:3271:x1875732255005440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788837913.161226:0:7599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837913.161232:0:7599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a458d3c800/0x2deb895b363e6413 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e640c expref: 20 pid: 5803 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.161247:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788837913.161254:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e733850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+3:11641:x1875732255005184:12345-0@lo:104: Request processed in 87us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837913.161260:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1788837913.161298:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837913.161303:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e63fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e6405 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.161310:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48a000 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:2.0:1788837913.161313:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e63fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e6405 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.161320:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e63fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e6405 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837913.161326:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e63fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e6405 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837913.161332:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788837913.161346:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e63fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e6405 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.161352:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788837913.161369:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e63fe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e6405 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.161375:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e63fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e6405 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.161395:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837913.161396:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837913.161397:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837913.161404:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837913.161413:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3274:1875732255005568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837913.161451:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788837913.161628:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a458d3dc00/0x2deb895b363e6421 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e641a expref: 20 pid: 5800 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.162056:0:7599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a458d3c800/0x2deb895b363e6413 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e640c expref: 20 pid: 5803 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.162087:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788837913.162087:0:7599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837913.162182:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+20:3271:x1875732255005312:12345-0@lo:103:ldlm_bl.0 Request processed in 1023us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837913.162190:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788837913.162226:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255005568 00000100:00100000:3.0:1788837913.162231:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255005568 00010000:00010000:3.0:1788837913.162245:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a47bbb5000/0x2deb895b363e6405 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e63fe expref: 20 pid: 5800 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837913.162261:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788837913.162267:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4497d6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+20:3274:x1875732255005568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788837913.162275:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837913.162279:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a47bbb5000/0x2deb895b363e6405 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e63fe expref: 20 pid: 5800 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.162287:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a47bbb5000/0x2deb895b363e6405 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e63fe expref: 20 pid: 5800 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.162308:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837913.162394:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4497d6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+20:3274:x1875732255005568:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837913.162401:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788837913.162467:0:7599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3271:x1875732255005440:12345-0@lo:103:ldlm_bl.0 Request processed in 1279us (1375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837913.162475:0:7599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:3.0:1788837913.162483:0:11641:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a458d3d200/0x2deb895b363e63f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf7c expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.162498:0:11641:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a458d3d200/0x2deb895b363e63f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf7c expref: 12 pid: 5800 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837913.162511:0:11641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1875732255005696:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788837913.163074:0:11641:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a458d3c400/0x2deb895b363e63f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf75 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.163085:0:11641:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a458d3c400/0x2deb895b363e63f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf75 expref: 12 pid: 5802 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837913.163094:0:11641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1875732255005824:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788837913.163127:0:11641:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a3476e6540 going to sleep for 11 seconds 00010000:00010000:3.0:1788837913.163150:0:11641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a458d3dc00/0x2deb895b363e6421 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e641a expref: 18 pid: 5800 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837913.163161:0:11641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1875732255004928:0@lo:104: 00010000:00010000:3.0:1788837913.163171:0:11641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a458d3c800/0x2deb895b363e6413 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e640c expref: 17 pid: 5803 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837913.163178:0:11641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1875732255005056:0@lo:104: 00010000:00010000:3.0:1788837913.163198:0:11641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a47bbb5000/0x2deb895b363e6405 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e63fe expref: 16 pid: 5800 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837913.163230:0:11641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1875732255005184:0@lo:104: 00000100:00100000:2.0:1788837913.163472:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732255005440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837913.163482:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732255005312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837913.163939:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3274:1875732255005568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837913.166081:0:11641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1875732255005696:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788837913.166096:0:11641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1875732255005824:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788837913.166145:0:11641:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a44a48b200/0x2deb895b363e6555 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837913.168636:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837913.168736:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240291968 00000100:00100000:0.0:1788837913.168747:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240291968 00010000:00010000:0.0:1788837913.168789:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a458d3d200/0x2deb895b363e63f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf7c expref: 13 pid: 5800 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837913.168830:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:0.0:1788837913.168840:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2352:x1875732240291968:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837913.168858:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837913.168863:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a458d3d200/0x2deb895b363e63f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf7c expref: 13 pid: 5800 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.168875:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a458d3d200/0x2deb895b363e63f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf7c expref: 13 pid: 5800 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.168894:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a458d3d200/0x2deb895b363e63f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf7c expref: 13 pid: 5800 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.168909:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837913.169064:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+12:2352:x1875732240291968:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 222us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837913.169074:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:3.0:1788837913.171640:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837913.171731:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240292096 00000100:00100000:1.0:1788837913.171741:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240292096 00010000:00010000:1.0:1788837913.171780:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a458d3c400/0x2deb895b363e63f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf75 expref: 12 pid: 5802 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837913.171824:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:1.0:1788837913.171835:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+12:2352:x1875732240292096:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837913.171849:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837913.171855:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a458d3c400/0x2deb895b363e63f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf75 expref: 12 pid: 5802 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.171866:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a458d3c400/0x2deb895b363e63f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf75 expref: 12 pid: 5802 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.171883:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a458d3c400/0x2deb895b363e63f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf75 expref: 12 pid: 5802 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.171900:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a44a48b200/0x2deb895b363e6555 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.171908:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a44a48b200/0x2deb895b363e6555 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.171925:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a44a48b200/0x2deb895b363e6555 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.171944:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a44a48b200/0x2deb895b363e6555 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.171951:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a44a48b200/0x2deb895b363e6555 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.171958:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a44a48b200/0x2deb895b363e6555 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.171964:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48b200 already unused, calling callback (ffffffffc1616420) 00010000:00010000:1.0:1788837913.171968:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a44a48b200/0x2deb895b363e6555 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.171975:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a44a48b200/0x2deb895b363e6555 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.171997:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a44a48b200/0x2deb895b363e6555 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.172008:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837913.172057:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+11:2352:x1875732240292096:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 224us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837913.172064:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 34 00010000:00010000:0.0:1788837913.172153:0:11641:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97a44a48b200/0x2deb895b363e6555 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.172162:0:11641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a44a48b200/0x2deb895b363e6555 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.172168:0:11641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a44a48b200/0x2deb895b363e6555 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837914.146519:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837915.015594:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837915.016829:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240292224 00000100:00100000:3.0:1788837915.016846:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240292224 00000100:00100000:3.0:1788837915.016993:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 255 00000100:00100000:3.0:1788837915.017006:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a460088c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+11:5591:x1875732240292224:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837915.017030:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837915.017058:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a44a48ae00/0x2deb895b363e655c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0cfc9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837915.017110:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a44a48ae00/0x2deb895b363e655c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cfc9 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837915.017125:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a44a48ae00/0x2deb895b363e655c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cfc9 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837915.017138:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48ae00, rc 0) 00000100:00100000:3.0:1788837915.020369:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a460088c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+12:5591:x1875732240292224:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 3354us (4773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837915.020381:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 255 00000100:00100000:1.0:1788837915.027421:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837915.029928:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240292352 00000100:00100000:3.0:1788837915.029945:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240292352 00000100:00100000:3.0:1788837915.030109:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 256 00000100:00100000:3.0:1788837915.030121:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+12:5591:x1875732240292352:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837915.030516:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+12:5591:x1875732240292352:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 397us (3117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837915.030525:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 256 00000100:00100000:0.0:1788837915.035910:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837915.036253:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240292480 00000100:00100000:3.0:1788837915.036265:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240292480 00000100:00100000:3.0:1788837915.036324:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 257 00000100:00100000:3.0:1788837915.036333:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+12:5591:x1875732240292480:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837915.036821:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+12:5591:x1875732240292480:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 487us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837915.036830:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 257 00000100:00100000:1.0:1788837915.045495:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837915.045898:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240292608 00000100:00100000:3.0:1788837915.045909:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240292608 00000100:00100000:3.0:1788837915.046021:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 258 00000100:00100000:3.0:1788837915.046032:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a56a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+12:9976:x1875732240292608:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788837915.046331:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a56a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+12:9976:x1875732240292608:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 300us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837915.046339:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 258 00000100:00100000:0.0:1788837915.051980:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837915.052169:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240292736 00000100:00100000:3.0:1788837915.052182:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240292736 00000100:00100000:3.0:1788837915.052350:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 259 00000100:00100000:3.0:1788837915.052359:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a56b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+12:9976:x1875732240292736:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788837915.053138:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a56b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+12:9976:x1875732240292736:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 776us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837915.053149:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 259 00000100:00100000:0.0:1788837915.087988:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837915.088240:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240292864 00000100:00100000:3.0:1788837915.088251:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240292864 00000100:00100000:3.0:1788837915.088313:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 260 00000100:00100000:3.0:1788837915.088324:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+12:5591:x1875732240292864:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837915.088341:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837915.088360:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a44a48b800/0x2deb895b363e6563 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0cfd0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837915.088390:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a44a48b800/0x2deb895b363e6563 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cfd0 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837915.088412:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a44a48b800/0x2deb895b363e6563 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cfd0 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837915.088422:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48b800, rc 0) 00000100:00100000:3.0:1788837915.088488:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:5591:x1875732240292864:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 166us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837915.088496:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 260 00000100:00100000:0.0:1788837915.090561:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837915.090822:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240292992 00000100:00100000:3.0:1788837915.090833:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240292992 00000100:00100000:3.0:1788837915.090890:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 261 00000100:00100000:3.0:1788837915.090899:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:5591:x1875732240292992:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837915.096553:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:5591:x1875732240292992:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 5642us (5988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837915.096568:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 261 00000100:00100000:0.0:1788837915.102975:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837915.103121:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240293120 00000100:00100000:2.0:1788837915.103132:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240293120 00000100:00100000:2.0:1788837915.103198:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 262 00000100:00100000:2.0:1788837915.103255:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:5591:x1875732240293120:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837915.103500:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:5591:x1875732240293120:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 247us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837915.103508:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 262 00000100:00100000:0.0:1788837915.107917:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837915.108240:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240293248 00000100:00100000:3.0:1788837915.108251:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240293248 00000100:00100000:3.0:1788837915.108328:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 263 00000100:00100000:3.0:1788837915.108337:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:9979:x1875732240293248:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788837915.108613:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:9979:x1875732240293248:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 275us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837915.108621:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 263 00000100:00100000:3.0:1788837915.112885:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837915.117375:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240293376 00000100:00100000:0.0:1788837915.117391:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240293376 00000100:00100000:0.0:1788837915.117544:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 264 00000100:00100000:0.0:1788837915.117556:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a56bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:9979:x1875732240293376:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788837915.117874:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a56bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:9979:x1875732240293376:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 320us (4998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837915.117882:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 264 10000000:01000000:0.0:1788837915.170434:0:5805:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788837915.170442:0:5805:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a3451f4000 from 7 10000000:01000000:0.0:1788837915.170448:0:5805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788837915.170513:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a46e790c00/0x2deb895b363e656a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837915.170525:0:5805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a46e790c00/0x2deb895b363e656a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837915.170537:0:5805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a46e790c00/0x2deb895b363e656a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837915.170565:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255005952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788837915.170657:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837915.170910:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f9f3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788837915.172380:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837915.174109:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255005952 00000100:00100000:2.0:1788837915.174124:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255005952 00000100:00100000:2.0:1788837915.174293:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788837915.174304:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:5805:x1875732255005952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837915.174323:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837915.174345:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a47bbb5000/0x2deb895b363e6571 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e656a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837915.174371:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a47bbb5000/0x2deb895b363e6571 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e656a expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837915.174396:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a47bbb5000/0x2deb895b363e6571 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e656a expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837915.174416:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5000, rc 0) 00000100:00100000:2.0:1788837915.174497:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:5805:x1875732255005952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (3839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837915.174503:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788837915.174609:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255005952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837915.174628:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a46e790c00/0x2deb895b363e656a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6571 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837915.174638:0:5805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a46e790c00/0x2deb895b363e656a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e6571 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837915.174708:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255006080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837915.174753:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837915.178810:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f9f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837915.181183:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255006080 00000100:00100000:3.0:1788837915.181216:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255006080 00000100:00100000:3.0:1788837915.181293:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788837915.181303:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a56b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:5805:x1875732255006080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837915.181677:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a56b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:5805:x1875732255006080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 375us (6922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837915.181686:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788837915.182136:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255006080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837915.182192:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255006208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837915.182264:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837915.185151:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f9f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837915.185358:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255006208 00000100:00100000:2.0:1788837915.185369:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255006208 00000100:00100000:2.0:1788837915.185434:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788837915.185444:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:5805:x1875732255006208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837915.185696:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:5805:x1875732255006208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 252us (3429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837915.185703:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788837915.185943:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255006208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837915.186987:0:11654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b660380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:11654:1875732255006336:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837915.187048:0:11654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837915.187093:0:11654:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f9f180 going to sleep for 11 seconds 00000100:00100000:2.0:1788837915.187151:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255006336 00000100:00100000:2.0:1788837915.187158:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255006336 00000100:00100000:2.0:1788837915.187188:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788837915.187195:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:11654:x1875732255006336:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837915.187434:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:11654:x1875732255006336:12345-0@lo:502:llog_process_th.0 Request processed in 238us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837915.187441:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788837915.187535:0:11654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b660380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:11654:1875732255006336:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788837915.187563:0:11654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837915.187575:0:11654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837915.187578:0:11654:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788837915.187595:0:11654:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97a3451f4000 00000020:00000080:0.0:1788837915.187598:0:11654:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788837915.187682:0:11654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b660380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:11654:1875732255006464:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837915.187716:0:11654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837915.187748:0:11654:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f9f180 going to sleep for 11 seconds 00000100:00100000:1.0:1788837915.189686:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255006464 00000100:00100000:1.0:1788837915.189701:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255006464 00000100:00100000:1.0:1788837915.190807:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788837915.190823:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:11654:x1875732255006464:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837915.191097:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:11654:x1875732255006464:12345-0@lo:502:llog_process_th.0 Request processed in 278us (3379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837915.191105:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788837915.191183:0:11654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b660380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:11654:1875732255006464:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788837915.191233:0:11654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788837915.191240:0:11654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837915.191243:0:11654:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788837915.191247:0:11654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788837915.191471:0:5805:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788837915.191490:0:5805:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788837915.191501:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a46e790c00/0x2deb895b363e656a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6571 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837915.191513:0:5805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a46e790c00/0x2deb895b363e656a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6571 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837915.191523:0:5805:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788837915.191525:0:5805:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a448f86800 from 7 10000000:01000000:3.0:1788837915.191528:0:5805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788837915.191561:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48a400/0x2deb895b363e6578 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837915.191657:0:5805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a44a48a400/0x2deb895b363e6578 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837915.191668:0:5805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a44a48a400/0x2deb895b363e6578 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837915.191688:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255006592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837915.191808:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837915.191849:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a3476e6840 going to sleep for 11 seconds 00000100:00100000:1.0:1788837915.192910:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255006592 00000100:00100000:1.0:1788837915.192919:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255006592 00000100:00100000:1.0:1788837915.192973:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788837915.192986:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:5805:x1875732255006592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837915.193001:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837915.193019:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a458d3c200/0x2deb895b363e657f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e6578 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837915.193044:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a458d3c200/0x2deb895b363e657f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e6578 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837915.193056:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a458d3c200/0x2deb895b363e657f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e6578 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837915.193064:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3c200, rc 0) 00000100:00100000:1.0:1788837915.193121:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:5805:x1875732255006592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837915.193129:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788837915.193264:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255006592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837915.193281:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a44a48a400/0x2deb895b363e6578 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e657f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837915.193290:0:5805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a44a48a400/0x2deb895b363e6578 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e657f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837915.193351:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255006720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837915.193383:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837915.193422:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a3476e6840 going to sleep for 11 seconds 00000100:00100000:1.0:1788837915.193483:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255006720 00000100:00100000:1.0:1788837915.193494:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255006720 00000100:00100000:1.0:1788837915.193524:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788837915.193530:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:5805:x1875732255006720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837915.194034:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:5805:x1875732255006720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 502us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837915.194042:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788837915.194095:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255006720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837915.194124:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255006848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837915.194163:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837915.194283:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a3476e6840 going to sleep for 11 seconds 00000100:00100000:0.0:1788837915.194366:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255006848 00000100:00100000:0.0:1788837915.194372:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255006848 00000100:00100000:0.0:1788837915.194440:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788837915.194448:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:5805:x1875732255006848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837915.194673:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:5805:x1875732255006848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 225us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837915.194680:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788837915.194863:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255006848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837915.195178:0:11656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:11656:1875732255006976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837915.195245:0:11656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837915.195273:0:11656:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4508c7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837915.195327:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255006976 00000100:00100000:3.0:1788837915.195332:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255006976 00000100:00100000:3.0:1788837915.195368:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788837915.195375:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:11656:x1875732255006976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837915.195537:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:11656:x1875732255006976:12345-0@lo:502:llog_process_th.0 Request processed in 162us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837915.195544:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788837915.195696:0:11656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:11656:1875732255006976:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788837915.195720:0:11656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788837915.195812:0:11656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837915.195815:0:11656:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788837915.195822:0:11656:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97a448f86800 00000020:00000080:1.0:1788837915.195824:0:11656:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788837915.195905:0:11656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:11656:1875732255007104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837915.195942:0:11656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837915.195955:0:11656:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4508c7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837915.196004:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255007104 00000100:00100000:3.0:1788837915.196009:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255007104 00000100:00100000:3.0:1788837915.196040:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788837915.196046:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:11656:x1875732255007104:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837915.196155:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:11656:x1875732255007104:12345-0@lo:502:llog_process_th.0 Request processed in 109us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837915.196162:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788837915.196714:0:11656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:11656:1875732255007104:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788837915.196826:0:11656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788837915.196832:0:11656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837915.196834:0:11656:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788837915.196837:0:11656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788837915.196988:0:5805:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788837915.197007:0:5805:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788837915.197017:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48a400/0x2deb895b363e6578 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e657f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837915.197028:0:5805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a44a48a400/0x2deb895b363e6578 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e657f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837915.197039:0:5805:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788837915.197041:0:5805:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a448c63800 from 7 10000000:01000000:3.0:1788837915.197044:0:5805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788837915.197074:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48bc00/0x2deb895b363e6586 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837915.197082:0:5805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a44a48bc00/0x2deb895b363e6586 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837915.197103:0:5805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a44a48bc00/0x2deb895b363e6586 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837915.197120:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255007232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837915.197165:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837915.197194:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a3476e6780 going to sleep for 11 seconds 00000100:00100000:3.0:1788837915.197684:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255007232 00000100:00100000:3.0:1788837915.197692:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255007232 00000100:00100000:0.0:1788837915.197992:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788837915.198005:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:5805:x1875732255007232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837915.198017:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837915.198031:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a46e791200/0x2deb895b363e658d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e6586 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837915.198055:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a46e791200/0x2deb895b363e658d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e6586 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837915.198074:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a46e791200/0x2deb895b363e658d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e6586 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837915.198082:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e791200, rc 0) 00000100:00100000:2.0:1788837915.198358:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255007232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837915.198374:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a44a48bc00/0x2deb895b363e6586 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e658d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837915.198395:0:5805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a44a48bc00/0x2deb895b363e6586 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e658d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837915.198470:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255007360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837915.198504:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837915.198526:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a346b713c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837915.199667:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255007360 00000100:00100000:2.0:1788837915.199764:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255007360 00000100:00100000:2.0:1788837915.199810:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788837915.199819:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+20:5805:x1875732255007360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837915.200124:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+20:5805:x1875732255007360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 305us (1619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837915.200131:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788837915.200184:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255007360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837915.200218:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:5805:x1875732255007232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837915.200225:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788837915.200247:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255007488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837915.200290:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837915.200325:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a346b713c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837915.200341:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255007488 00000100:00100000:0.0:1788837915.200345:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255007488 00000100:00100000:0.0:1788837915.200377:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788837915.200384:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:5805:x1875732255007488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837915.200540:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:5805:x1875732255007488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837915.200547:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788837915.200702:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e394dacb-3a10-4fe7-bf6d-0294b37a120d:5805:1875732255007488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837915.200940:0:11658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b662680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:11658:1875732255007616:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837915.200972:0:11658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837915.200991:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255007616 00000100:00100000:0.0:1788837915.200994:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255007616 00000100:00100000:0.0:1788837915.201013:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788837915.201018:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:11658:x1875732255007616:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837915.201237:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:11658:x1875732255007616:12345-0@lo:502:llog_process_th.0 Request processed in 118us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837915.201246:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788837915.201278:0:11658:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f9f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837915.201290:0:11658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b662680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:11658:1875732255007616:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788837915.201309:0:11658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837915.201318:0:11658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837915.201321:0:11658:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788837915.201328:0:11658:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97a448c63800 00000020:00000080:0.0:1788837915.201331:0:11658:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788837915.201407:0:11658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b662680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:11658:1875732255007744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837915.201436:0:11658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837915.201453:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255007744 00000100:00100000:0.0:1788837915.201456:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255007744 00000100:00100000:0.0:1788837915.201473:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788837915.201552:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:11658:x1875732255007744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837915.201816:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:11658:x1875732255007744:12345-0@lo:502:llog_process_th.0 Request processed in 335us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837915.201822:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788837915.201847:0:11658:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f9f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837915.201860:0:11658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b662680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e394dacb-3a10-4fe7-bf6d-0294b37a120d:11658:1875732255007744:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788837915.201877:0:11658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837915.201882:0:11658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837915.201884:0:11658:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788837915.201887:0:11658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788837915.201943:0:5805:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788837915.201959:0:5805:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788837915.201969:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48bc00/0x2deb895b363e6586 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e658d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837915.201981:0:5805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a44a48bc00/0x2deb895b363e6586 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e658d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788837915.208930:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788837915.298694:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837915.299785:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255007872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837915.299860:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837915.300134:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255007872 00000100:00100000:1.0:1788837915.300143:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255007872 00000100:00100000:1.0:1788837915.300292:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788837915.300305:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3273:x1875732255007872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788837915.300345:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837915.300511:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3273:x1875732255007872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 209us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837915.300519:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1788837915.300602:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837915.300661:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255007872:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788837916.195157:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788837916.259785:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788837916.836193:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255008000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837916.836322:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837916.836482:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255008000 00000100:00100000:0.0:1788837916.836494:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255008000 00000100:00100000:0.0:1788837916.836577:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788837916.836590:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255008000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788837916.836640:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788837916.836766:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837916.836950:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732255008128:0@lo:400:kworker.0 00000100:00100000:1.0:1788837916.836998:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837916.837055:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255008128 00000100:00100000:1.0:1788837916.837061:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255008128 00000100:00100000:1.0:1788837916.837097:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788837916.837105:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3272:x1875732255008128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837916.837143:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3272:x1875732255008128:12345-0@lo:400:kworker.0 Request processed in 39us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837916.837151:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788837916.837234:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732255008128:0@lo:400:kworker.0 00000100:00100000:0.0:1788837916.837846:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255008000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1255us (1520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837916.837856:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788837916.839901:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3272:1875732255008640:0@lo:400:kworker.0 00000100:00100000:1.0:1788837916.840025:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837916.840092:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837916.840100:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255008512:0@lo:400:kworker.0 00000100:00100000:1.0:1788837916.840131:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837916.840168:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732255008256:0@lo:400:kworker.0 00000100:00100000:1.0:1788837916.840196:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837916.840405:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837916.840412:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732255008384:0@lo:400:kworker.0 00000100:00100000:1.0:1788837916.840438:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837916.841153:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255008640 00000100:00100000:2.0:1788837916.841167:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255008640 00000100:00100000:2.0:1788837916.841424:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255008256 00000100:00100000:2.0:1788837916.841429:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255008256 00000100:00100000:2.0:1788837916.841450:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255008384 00000100:00080000:1.0:1788837916.841869:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837916.842013:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255008512 00000100:00100000:0.0:1788837916.842022:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255008512 00000100:00100000:0.0:1788837916.842235:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788837916.842249:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3272:x1875732255008512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837916.842429:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255008384 00000100:00100000:0.0:1788837916.842637:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3272:x1875732255008512:12345-0@lo:400:kworker.0 Request processed in 389us (2502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837916.842645:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788837916.842746:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788837916.842757:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3272:x1875732255008640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837916.842793:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3272:x1875732255008640:12345-0@lo:400:kworker.0 Request processed in 39us (2770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837916.842799:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788837916.842814:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788837916.842821:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732255008256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837916.842856:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732255008256:12345-0@lo:400:kworker.0 Request processed in 36us (2659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837916.842874:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:1.0:1788837916.842881:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837916.842890:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788837916.842897:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1875732255008384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837916.842926:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1875732255008384:12345-0@lo:400:kworker.0 Request processed in 30us (2487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837916.842931:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788837916.842994:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732255008384:0@lo:400:kworker.0 00000100:00100000:1.0:1788837916.843195:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255008512:0@lo:400:kworker.0 00000100:00100000:0.0:1788837916.843198:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732255008256:0@lo:400:kworker.0 00000100:00100000:1.0:1788837916.843858:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3272:1875732255008640:0@lo:400:kworker.0 00010000:00080000:3.0:1788837916.845274:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a44a40aa00 x1875732255008000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837916.845310:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255008000:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788837917.218823:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837917.908573:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837917.908623:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837917.908657:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837917.908686:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837917.908715:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240293632 00000100:00100000:3.0:1788837917.908726:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240293632 00000100:00100000:3.0:1788837917.908785:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240293888 00000100:00100000:3.0:1788837917.908788:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240293888 00000100:00100000:3.0:1788837917.908814:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00100000:3.0:1788837917.908825:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2351:x1875732240293632:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788837917.908927:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2351:x1875732240293632:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 103us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837917.908937:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00100000:3.0:1788837917.908958:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:3.0:1788837917.908965:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2351:x1875732240293888:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788837917.908990:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2351:x1875732240293888:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 26us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837917.908996:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:3.0:1788837917.909020:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240293504 00000100:00100000:3.0:1788837917.909024:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240293504 00000100:00100000:3.0:1788837917.909050:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 281 00000100:00100000:3.0:1788837917.909056:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2351:x1875732240293504:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788837917.909079:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2351:x1875732240293504:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 23us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837917.909084:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 281 00000100:00100000:3.0:1788837917.909110:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240293760 00000100:00100000:3.0:1788837917.909114:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240293760 00000100:00100000:3.0:1788837917.909146:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:3.0:1788837917.909153:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2351:x1875732240293760:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788837917.909181:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2351:x1875732240293760:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 29us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837917.909187:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00080000:3.0:1788837917.909229:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788837917.909235:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1788837917.957024:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1788837918.242585:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837919.267785:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837920.291225:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837920.420223:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47fc54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255008768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837920.420337:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837920.420742:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255008768 00000100:00100000:1.0:1788837920.420846:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255008768 00000100:00100000:1.0:1788837920.420979:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788837920.420990:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255008768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788837920.421037:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837920.421107:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255008768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837920.421115:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788837920.423646:0:3273:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1788837920.423663:0:3273:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97a44a409c00, transno 4294967300 00000100:00100000:2.0:1788837920.423710:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47fc54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255008768:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788837920.436786:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788837921.315506:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837921.954695:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47fc54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255008896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837921.954801:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837921.955124:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255008896 00000100:00100000:1.0:1788837921.955137:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255008896 00000100:00100000:1.0:1788837921.955247:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788837921.955260:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732255008896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837921.955320:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837921.955391:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732255008896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837921.955399:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1788837921.955469:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788837921.955588:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a47fc54000 x1875732255008896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837937 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837921.955613:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47fc54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255008896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837921.960261:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448f90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732255009280:0@lo:400:kworker.0 00000100:00100000:0.0:1788837921.960261:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448f90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255009408:0@lo:400:kworker.0 00000100:00100000:2.0:1788837921.960353:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448f91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3272:1875732255009152:0@lo:400:kworker.0 00000100:00100000:3.0:1788837921.960413:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47fc54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732255009024:0@lo:400:kworker.0 00000100:00100000:0.0:1788837921.961906:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837921.962021:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255009408 00000100:00100000:0.0:1788837921.962032:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255009408 00000100:00100000:0.0:1788837921.962119:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788837921.962132:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b660a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732255009408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837921.962395:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b660a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732255009408:12345-0@lo:400:kworker.0 Request processed in 265us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837921.962404:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788837921.962994:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837921.963050:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255009152 00000100:00100000:2.0:1788837921.963057:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255009152 00000100:00100000:2.0:1788837921.963100:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788837921.963122:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1875732255009152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837921.963171:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1875732255009152:12345-0@lo:400:kworker.0 Request processed in 64us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837921.963179:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788837921.963242:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448f91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3272:1875732255009152:0@lo:400:kworker.0 00000100:00100000:1.0:1788837921.966400:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837921.966618:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448f90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255009408:0@lo:400:kworker.0 00000100:00100000:2.0:1788837921.967076:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837921.967196:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448f92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732255009536:0@lo:400:kworker.0 00000100:00100000:2.0:1788837921.967276:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837921.967297:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255009024 00000100:00100000:1.0:1788837921.967309:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255009024 00000100:00100000:1.0:1788837921.967390:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788837921.967404:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3271:x1875732255009024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837921.967483:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3271:x1875732255009024:12345-0@lo:400:kworker.0 Request processed in 83us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837921.967493:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788837921.967513:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255009280 00000100:00100000:3.0:1788837921.967520:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255009280 00000100:00100000:3.0:1788837921.967567:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255009536 00000100:00100000:3.0:1788837921.967570:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255009536 00000100:00100000:3.0:1788837921.967596:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788837921.967603:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1875732255009280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837921.967668:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1875732255009280:12345-0@lo:400:kworker.0 Request processed in 65us (1280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837921.967675:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788837921.967692:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788837921.967699:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1875732255009536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837921.967728:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1875732255009536:12345-0@lo:400:kworker.0 Request processed in 31us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837921.967734:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:3.0:1788837921.967758:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837921.967797:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448f90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732255009280:0@lo:400:kworker.0 00000100:00100000:2.0:1788837921.967988:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47fc54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732255009024:0@lo:400:kworker.0 00000100:00100000:2.0:1788837921.968002:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448f92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732255009536:0@lo:400:kworker.0 00010000:00010000:0.0:1788837922.338805:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837923.026458:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837923.026501:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837923.026540:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837923.026577:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837923.026659:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240294272 00000100:00100000:0.0:1788837923.026668:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240294272 00000100:00100000:0.0:1788837923.026735:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:0.0:1788837923.026746:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2349:x1875732240294272:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788837923.026815:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2349:x1875732240294272:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 71us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837923.026822:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00080000:1.0:1788837923.027240:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837923.027459:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240294016 00000100:00100000:3.0:1788837923.027468:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240294016 00000100:00100000:3.0:1788837923.027514:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 283 00000100:00100000:3.0:1788837923.027523:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a523050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2349:x1875732240294016:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788837923.027571:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a523050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2349:x1875732240294016:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 49us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837923.027594:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 283 00000100:00100000:3.0:1788837923.027629:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240294144 00000100:00100000:3.0:1788837923.027634:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240294144 00000100:00100000:3.0:1788837923.027667:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240294400 00000100:00100000:3.0:1788837923.027670:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240294400 00000100:00100000:3.0:1788837923.027691:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 121 00000100:00100000:3.0:1788837923.027698:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2349:x1875732240294144:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788837923.027729:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2349:x1875732240294144:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 32us (1188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837923.027735:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 121 00000100:00100000:3.0:1788837923.027748:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00100000:3.0:1788837923.027754:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2349:x1875732240294400:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788837923.027776:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2349:x1875732240294400:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 22us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837923.027782:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00080000:3.0:1788837923.027803:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788837923.362797:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837924.392247:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837925.410504:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837925.538766:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837925.538791:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448f90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255009664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837925.538874:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837925.539018:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255009664 00000100:00100000:0.0:1788837925.539026:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255009664 00000100:00080000:1.0:1788837925.542847:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837925.543115:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788837925.543138:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255009664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788837925.543184:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837925.543310:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255009664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 185us (4434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837925.543457:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448f90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255009664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837925.543784:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00010000:0.0:1788837926.435321:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788837926.499821:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788837927.074881:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448f91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3274:1875732255009920:0@lo:400:kworker.0 00000100:00100000:1.0:1788837927.074914:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255010176:0@lo:400:kworker.0 00000100:00100000:3.0:1788837927.075014:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448f90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732255009792:0@lo:400:kworker.0 00000100:00100000:0.0:1788837927.075161:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448f90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732255010048:0@lo:400:kworker.0 00000100:00100000:1.0:1788837927.080856:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837927.080992:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255010176 00000100:00100000:1.0:1788837927.081001:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255010176 00000100:00100000:1.0:1788837927.081068:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788837927.081079:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a347358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255010176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837927.081143:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a347358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255010176:12345-0@lo:400:kworker.0 Request processed in 67us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837927.081150:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788837927.081185:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837927.081239:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255010176:0@lo:400:kworker.0 00000100:00100000:3.0:1788837927.086623:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837927.086694:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732255010304:0@lo:400:kworker.0 00000100:00100000:3.0:1788837927.086762:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837927.086808:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837927.086816:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255010432:0@lo:400:kworker.0 00000100:00100000:3.0:1788837927.086847:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837927.086914:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255010304 00000100:00100000:3.0:1788837927.086924:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255010304 00000100:00100000:3.0:1788837927.087016:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788837927.087030:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1875732255010304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837927.087166:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255009792 00000100:00100000:1.0:1788837927.087182:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255009792 00000100:00100000:1.0:1788837927.087257:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788837927.087272:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3273:x1875732255009792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837927.087308:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3273:x1875732255009792:12345-0@lo:400:kworker.0 Request processed in 37us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837927.087315:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788837927.087387:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255010432 00000100:00100000:1.0:1788837927.087390:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255010432 00000100:00100000:1.0:1788837927.087419:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788837927.087426:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255010432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837927.087458:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255010432:12345-0@lo:400:kworker.0 Request processed in 32us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837927.087464:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1788837927.087484:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788837927.087490:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837927.087692:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1875732255010304:12345-0@lo:400:kworker.0 Request processed in 664us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837927.087699:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:3.0:1788837927.087749:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a458c90a80 x1875732255010432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837927.087765:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255010432:0@lo:400:kworker.0 00000100:00100000:3.0:1788837927.087776:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448f90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732255009792:0@lo:400:kworker.0 00000100:00100000:3.0:1788837927.087787:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732255010304:0@lo:400:kworker.0 00000100:00100000:0.0:1788837927.089262:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837927.089323:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255010560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837927.089422:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837927.090345:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255010560 00000100:00100000:1.0:1788837927.090363:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255010560 00000100:00100000:1.0:1788837927.090456:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788837927.090468:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255010560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837927.090525:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837927.090626:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255010560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837927.090634:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788837927.090737:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255010048 00000100:00100000:3.0:1788837927.090743:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255010048 00000100:00100000:3.0:1788837927.090803:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788837927.090811:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732255010048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837927.090854:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732255010048:12345-0@lo:400:kworker.0 Request processed in 44us (1603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837927.090861:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:1.0:1788837927.090940:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837927.091047:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448f90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732255010048:0@lo:400:kworker.0 00010000:00080000:0.0:1788837927.091066:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a47b663480 x1875732255010560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837943 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837927.091087:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255010560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837927.091408:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837927.091508:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255009920 00000100:00100000:3.0:1788837927.091514:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255009920 00000100:00100000:3.0:1788837927.091560:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788837927.091568:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1875732255009920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837927.091622:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1875732255009920:12345-0@lo:400:kworker.0 Request processed in 55us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837927.091629:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788837927.091744:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448f91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3274:1875732255009920:0@lo:400:kworker.0 00010000:00010000:3.0:1788837927.458912:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837928.143584:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837928.144006:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837928.144111:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240294656 00000100:00100000:3.0:1788837928.144123:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240294656 00000100:00100000:3.0:1788837928.144236:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 126 00000100:00100000:3.0:1788837928.144247:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2352:x1875732240294656:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788837928.144336:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2352:x1875732240294656:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 90us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837928.144344:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 126 00000100:00080000:1.0:1788837928.144520:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837928.146313:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240294528 00000100:00100000:0.0:1788837928.146326:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240294528 00000100:00100000:0.0:1788837928.146473:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 285 00000100:00100000:0.0:1788837928.146484:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a520450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2352:x1875732240294528:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788837928.146773:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a520450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2352:x1875732240294528:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 290us (3201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837928.146781:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 285 00000100:00100000:2.0:1788837928.165501:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837928.165560:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837928.165671:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240294784 00000100:00100000:1.0:1788837928.165683:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240294784 00000100:00100000:1.0:1788837928.165791:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:1.0:1788837928.165806:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2348:x1875732240294784:12345-192.168.204.54@tcp:9:kworker.0 00000020:00000080:1.0:1788837928.165869:0:6653:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e64c9 00000100:00080000:1.0:1788837928.165882:0:6653:0:(import.c:65:import_set_state_nolock()) ffff97a449767000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788837928.165949:0:6653:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:0.0:1788837928.166284:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837928.166746:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+2:2348:x1875732240294784:12345-192.168.204.54@tcp:9:kworker.0 Request processed in 941us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837928.166758:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00080000:2.0:1788837928.166903:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837928.167985:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240294912 00000100:00100000:3.0:1788837928.168001:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240294912 00000100:00100000:3.0:1788837928.168296:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 127 00000100:00100000:3.0:1788837928.168309:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2352:x1875732240294912:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788837928.168423:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2352:x1875732240294912:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 116us (2861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837928.168432:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 127 00000100:00080000:2.0:1788837928.169463:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788837928.483572:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837929.507853:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837930.530750:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837930.659187:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a347358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255010688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837930.660430:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837930.667691:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255010688 00000100:00100000:1.0:1788837930.667718:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255010688 00000100:00100000:1.0:1788837930.667848:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788837930.667870:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255010688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788837930.667925:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837930.668562:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255010688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 700us (8133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837930.668573:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1788837930.669184:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837930.671772:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a347358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255010688:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788837931.554418:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837932.194814:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732255011072:0@lo:400:kworker.0 00000100:00100000:3.0:1788837932.194926:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a347358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732255010816:0@lo:400:kworker.0 00000100:00100000:0.0:1788837932.194926:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837932.194974:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837932.195009:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732255011328:0@lo:400:kworker.0 00000100:00100000:0.0:1788837932.195015:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837932.195021:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255011200:0@lo:400:kworker.0 00000100:00100000:0.0:1788837932.195053:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837932.195055:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837932.195088:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788837932.195094:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a347358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732255010944:0@lo:400:kworker.0 00000100:00100000:0.0:1788837932.195114:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255011072 00000100:00100000:3.0:1788837932.195120:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837932.195124:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255011072 00000100:00100000:0.0:1788837932.195198:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255011328 00000100:00100000:0.0:1788837932.195222:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255011328 00000100:00100000:0.0:1788837932.195248:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255010944 00000100:00100000:0.0:1788837932.195251:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255010944 00000100:00100000:0.0:1788837932.195269:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788837932.195279:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732255011072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837932.195345:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732255011072:12345-0@lo:400:kworker.0 Request processed in 66us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837932.195360:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788837932.195382:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788837932.195389:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255011456:0@lo:400:kworker.0 00000100:00100000:0.0:1788837932.195389:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1875732255011328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837932.195415:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837932.195417:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1875732255011328:12345-0@lo:400:kworker.0 Request processed in 30us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837932.195423:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788837932.195434:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788837932.195439:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732255010944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837932.195452:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732255011328:0@lo:400:kworker.0 00000100:00100000:0.0:1788837932.195463:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732255010944:12345-0@lo:400:kworker.0 Request processed in 24us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837932.195468:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788837932.195475:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a347358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732255010944:0@lo:400:kworker.0 00000100:00100000:0.0:1788837932.195488:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255011200 00000100:00100000:0.0:1788837932.195491:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255011200 00000100:00100000:0.0:1788837932.195523:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255011456 00000100:00100000:0.0:1788837932.195526:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255011456 00000100:00100000:0.0:1788837932.195546:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788837932.195553:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255011200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837932.195585:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255011200:12345-0@lo:400:kworker.0 Request processed in 34us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837932.195591:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788837932.195601:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788837932.195607:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255011456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837932.195638:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255011456:12345-0@lo:400:kworker.0 Request processed in 31us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837932.195644:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788837932.195646:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255011200:0@lo:400:kworker.0 00000100:00100000:3.0:1788837932.195657:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732255011072:0@lo:400:kworker.0 00010000:00080000:0.0:1788837932.195679:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a46f4b8a80 x1875732255011456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837932.195691:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255011456:0@lo:400:kworker.0 00000100:00080000:2.0:1788837932.195883:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788837932.195889:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788837932.195893:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837932.195916:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255010816 00000100:00100000:2.0:1788837932.195920:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255010816 00000100:00100000:2.0:1788837932.195957:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788837932.195965:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a520c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3273:x1875732255010816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837932.196392:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255011584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837932.196418:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a520c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3273:x1875732255010816:12345-0@lo:400:kworker.0 Request processed in 454us (1443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837932.196426:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788837932.196429:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837932.196511:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255011584 00000100:00100000:0.0:1788837932.196516:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255011584 00000100:00100000:0.0:1788837932.196556:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788837932.196564:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a347358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255011584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788837932.196602:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837932.196650:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a347358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255011584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837932.196656:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1788837932.196734:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a46f4b9500 x1875732255011584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837948 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837932.196753:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255011584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837932.199950:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a347358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732255010816:0@lo:400:kworker.0 00010000:00010000:2.0:1788837932.583764:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837933.261488:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837933.261539:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837933.261570:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837933.261612:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240295040 00000100:00100000:1.0:1788837933.261628:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240295040 00000100:00100000:1.0:1788837933.261710:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 287 00000100:00100000:1.0:1788837933.261722:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a521850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2351:x1875732240295040:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788837933.262161:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a521850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2351:x1875732240295040:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 438us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837933.262174:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 287 00000100:00100000:1.0:1788837933.262253:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240295168 00000100:00100000:1.0:1788837933.262259:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240295168 00000100:00100000:1.0:1788837933.262302:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240295296 00000100:00100000:1.0:1788837933.262306:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240295296 00000100:00100000:1.0:1788837933.262553:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 131 00000100:00100000:1.0:1788837933.262562:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2351:x1875732240295168:12345-192.168.204.54@tcp:400:kworker.0 00000100:00080000:3.0:1788837933.262667:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837933.262920:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2351:x1875732240295168:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 358us (1378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837933.262928:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 131 00000100:00100000:1.0:1788837933.262945:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 132 00000100:00100000:1.0:1788837933.262953:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2351:x1875732240295296:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788837933.262986:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2351:x1875732240295296:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 35us (1415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837933.262996:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 132 00000001:00100000:3.0:1788837933.307824:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7 00000020:00000080:3.0:1788837933.307838:0:6676:0:(genops.c:885:class_export_put()) final put ffff97a461921800/f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7 00000020:00000080:1.0:1788837933.307927:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97a461921800/f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7 for lustre-OST0000 00000020:00000080:1.0:1788837933.308009:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a449767000 for lustre-OST0000 00010000:00010000:0.0:1788837933.603413:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837934.627946:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837935.653437:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837935.783547:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255011712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837935.783641:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837935.784018:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255011712 00000100:00100000:3.0:1788837935.784028:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255011712 00000100:00100000:3.0:1788837935.784098:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788837935.784108:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255011712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788837935.784149:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788837935.784225:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837935.792866:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255011712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8747us (9212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837935.792880:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788837935.794482:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255011712:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788837936.675844:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788837936.738923:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788837937.314458:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732255011840:0@lo:400:kworker.0 00000100:00100000:1.0:1788837937.314532:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837937.314581:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732255012352:0@lo:400:kworker.0 00000100:00100000:1.0:1788837937.314609:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837937.314639:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788837937.314663:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732255011968:0@lo:400:kworker.0 00000100:00100000:1.0:1788837937.314689:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837937.314707:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255012480:0@lo:400:kworker.0 00000100:00100000:1.0:1788837937.314734:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837937.314775:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732255012096:0@lo:400:kworker.0 00000100:00100000:1.0:1788837937.314801:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837937.314833:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788837937.314838:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255012224:0@lo:400:kworker.0 00000100:00100000:1.0:1788837937.314861:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837937.314893:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255012352 00000100:00100000:1.0:1788837937.314901:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255012352 00000100:00100000:1.0:1788837937.314946:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255011968 00000100:00100000:1.0:1788837937.314949:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255011968 00000100:00100000:1.0:1788837937.314963:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255012096 00000100:00100000:1.0:1788837937.314965:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255012096 00000100:00100000:1.0:1788837937.314995:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788837937.315003:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1875732255012352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837937.315062:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1875732255012352:12345-0@lo:400:kworker.0 Request processed in 59us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837937.315074:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788837937.315094:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788837937.315100:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459205c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732255011968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837937.315139:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459205c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732255011968:12345-0@lo:400:kworker.0 Request processed in 28us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837937.315144:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788837937.315155:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788837937.315161:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459204a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732255012096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837937.315192:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459204a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732255012096:12345-0@lo:400:kworker.0 Request processed in 32us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837937.315197:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788837937.315246:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255012480 00000100:00100000:1.0:1788837937.315250:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255012480 00000100:00100000:1.0:1788837937.315276:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255012224 00000100:00100000:1.0:1788837937.315279:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255012224 00000100:00100000:1.0:1788837937.315309:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788837937.315315:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459206d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255012480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837937.315346:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459206d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255012480:12345-0@lo:400:kworker.0 Request processed in 31us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837937.315352:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788837937.315363:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788837937.315368:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459206300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255012224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837937.315394:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459206300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255012224:12345-0@lo:400:kworker.0 Request processed in 27us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837937.315400:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1788837937.315420:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788837937.315424:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788837937.315426:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837937.315468:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255012224:0@lo:400:kworker.0 00000100:00100000:1.0:1788837937.315479:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732255012096:0@lo:400:kworker.0 00000100:00100000:1.0:1788837937.315515:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732255011968:0@lo:400:kworker.0 00010000:00080000:1.0:1788837937.315526:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a46f4b9500 x1875732255012480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837937.315536:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255012480:0@lo:400:kworker.0 00000100:00100000:1.0:1788837937.315546:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732255012352:0@lo:400:kworker.0 00000100:00100000:3.0:1788837937.317685:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255011840 00000100:00100000:3.0:1788837937.317697:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255011840 00000100:00100000:3.0:1788837937.317741:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788837937.317752:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a522c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3273:x1875732255011840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837937.317837:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a522c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3273:x1875732255011840:12345-0@lo:400:kworker.0 Request processed in 87us (3304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837937.317846:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788837937.318108:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837937.318123:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459204700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255012608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837937.318373:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837937.318410:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255012608 00000100:00100000:1.0:1788837937.318424:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255012608 00000100:00100000:1.0:1788837937.318457:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788837937.318465:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255012608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837937.318494:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837937.318532:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255012608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837937.318539:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1788837937.318576:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a459204700 x1875732255012608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837937.318597:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459204700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255012608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837937.318627:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732255011840:0@lo:400:kworker.0 00000001:02000400:2.0:1788837937.453553:0:11825:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 23:25:35 (1788837935) 00010000:00010000:0.0:1788837937.699085:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837938.375735:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837938.375804:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837938.375845:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837938.376062:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240295424 00000100:00100000:3.0:1788837938.376073:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240295424 00000100:00100000:3.0:1788837938.376135:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 289 00000100:00100000:3.0:1788837938.376352:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2350:x1875732240295424:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788837938.376427:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2350:x1875732240295424:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 283us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837938.376435:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 289 00000100:00100000:0.0:1788837938.376876:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240295552 00000100:00100000:0.0:1788837938.376882:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240295552 00000100:00100000:0.0:1788837938.376925:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240295680 00000100:00100000:0.0:1788837938.376928:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240295680 00000100:00100000:0.0:1788837938.376962:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 136 00000100:00100000:0.0:1788837938.376971:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2350:x1875732240295552:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788837938.377016:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2350:x1875732240295552:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 46us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837938.377024:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 136 00000100:00100000:0.0:1788837938.377049:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 137 00000100:00100000:0.0:1788837938.377073:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2350:x1875732240295680:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788837938.377106:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2350:x1875732240295680:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 34us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837938.377112:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 137 00000100:00080000:1.0:1788837938.377555:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788837938.722456:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837939.377806:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837939.377915:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240295808 00000100:00100000:2.0:1788837939.377927:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240295808 00000100:00100000:2.0:1788837939.378019:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:2.0:1788837939.378029:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:10247:x1875732240295808:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837939.378051:0:10730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837939.378076:0:10730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6594 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0cfd7 expref: -99 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.378141:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e659b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.378155:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e659b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.378168:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e659b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837939.378199:0:10730:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788837939.378243:0:10730:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837939.378280:0:10730:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e659b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.378301:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6594 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cfd7 expref: 7 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.378319:0:10730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e659b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cfd7 expref: 6 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.378327:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a448b3c200) 00010000:00010000:2.0:1788837939.378330:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788837939.378333:0:10730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4a00, rc 0) 00000100:00100000:2.0:1788837939.378387:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:10247:x1875732240295808:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 360us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837939.378399:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:2.0:1788837939.396441:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837939.396568:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240295936 00000100:00100000:1.0:1788837939.396579:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240295936 00000100:00100000:1.0:1788837939.396654:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:1.0:1788837939.396665:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:10248:x1875732240295936:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788837939.396685:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837939.396707:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e65a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0cfde expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.396771:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e65a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.396802:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e65a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.396813:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e65a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.396830:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e65b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.396837:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e65b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.396844:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e65b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.397065:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d600/0x2deb895b363e65b7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.397075:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d600/0x2deb895b363e65b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.397083:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d600/0x2deb895b363e65b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837939.397110:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788837939.397115:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788837939.397135:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d600/0x2deb895b363e65b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.397146:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e65a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.397176:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e65a9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.397183:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e65a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.397189:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3d400 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837939.397193:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e65a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.397229:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e65a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.397243:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a448b3c200) 00010000:00010000:1.0:1788837939.397246:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837939.397250:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e65a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.397255:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e65a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.397268:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e65b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.397274:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e65b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.397281:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e65b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.397287:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3d000 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837939.397295:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e65b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.397301:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e65b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.397308:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff97a45487f200) 00010000:00010000:1.0:1788837939.397311:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837939.397313:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e65b0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.397318:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e65b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.397349:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e65a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cfde expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.397361:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d600/0x2deb895b363e65b7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cfde expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.397369:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97a45487fd00) 00010000:00010000:1.0:1788837939.397372:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788837939.397375:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3d600, rc 0) 00000100:00100000:1.0:1788837939.397440:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:10248:x1875732240295936:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 776us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837939.397447:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:3.0:1788837939.406769:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837939.406993:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240296192 00000100:00100000:2.0:1788837939.407003:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240296192 00000100:00100000:2.0:1788837939.407071:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:2.0:1788837939.407082:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a347358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:10248:x1875732240296192:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837939.407102:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837939.407133:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e65be lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0cfe5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.407256:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e65c5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.407272:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e65c5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.407282:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e65c5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.407342:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e65cc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.407350:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e65cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.407356:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e65cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.407700:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e65d3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.407715:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e65d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.407723:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e65d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837939.407733:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788837939.407889:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e65c5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.407897:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e65c5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.407904:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e65c5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.407911:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5c00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837939.407915:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e65c5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.407922:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e65c5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.407946:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97a45487fd00) 00010000:00010000:2.0:1788837939.407949:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837939.407954:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e65c5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.407959:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e65c5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.407973:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e65cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.407986:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e65cc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.407992:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e65cc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.407998:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4400 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837939.408001:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e65cc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.408006:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e65cc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.408015:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff97a448b3cd00) 00010000:00010000:2.0:1788837939.408017:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837939.408020:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e65cc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.408025:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e65cc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.408533:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e65be lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cfe5 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.408549:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e65d3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cfe5 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.408557:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a448b3cf00) 00010000:00010000:2.0:1788837939.408560:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837939.408569:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4800, rc 0) 00000100:00100000:2.0:1788837939.408640:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a347358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+9:10248:x1875732240296192:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1560us (1885us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788837939.408650:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:3.0:1788837939.414899:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837939.415078:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240296320 00000100:00100000:0.0:1788837939.415089:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240296320 00000100:00100000:0.0:1788837939.415169:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:0.0:1788837939.415181:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+9:10248:x1875732240296320:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788837939.415574:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+9:10248:x1875732240296320:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 Request processed in 393us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837939.415583:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 35 00010000:00010000:3.0:1788837939.746417:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788837939.812075:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788837940.772247:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837940.898550:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255012736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837940.898819:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837940.900796:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255012736 00000100:00100000:3.0:1788837940.901004:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255012736 00000100:00100000:3.0:1788837940.901085:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788837940.901104:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255012736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788837940.901143:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788837940.901352:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255012736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 249us (2532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837940.901360:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1788837940.901445:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837940.901491:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255012736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837941.474633:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837941.474701:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240296448 00000100:00100000:2.0:1788837941.474711:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240296448 00000100:00100000:2.0:1788837941.474786:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:2.0:1788837941.474795:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+9:10290:x1875732240296448:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788837941.474814:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837941.474835:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e65e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0cfec expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.474909:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e65e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.474933:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e65e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.474946:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e65e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.474960:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e65ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.474967:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e65ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.474984:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e65ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.475186:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e65e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.475194:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e65e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.475236:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e65e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.475243:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837941.475247:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e65e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.475254:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e65e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.475267:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a448b3c200) 00010000:00010000:2.0:1788837941.475269:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837941.475273:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e65e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.475279:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e65e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.475302:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e65ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.475308:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e65ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.475321:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e65ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.475326:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5c00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837941.475329:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e65ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.475335:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e65ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.475344:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff97a448b3cd00) 00010000:00010000:2.0:1788837941.475346:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837941.475349:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e65ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.475355:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e65ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.475387:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e65e1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cfec expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.475396:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a448b3c200) 00010000:00010000:2.0:1788837941.475398:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837941.475402:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e65e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cfec expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.475410:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4e00, rc 0) 00000100:00100000:2.0:1788837941.475474:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+9:10290:x1875732240296448:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 681us (850us total) trans 0 rc 301/301 00000100:00100000:2.0:1788837941.475489:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00080000:0.0:1788837941.475810:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837941.493268:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837941.493417:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240296704 00000100:00100000:0.0:1788837941.493427:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240296704 00000100:00100000:0.0:1788837941.493493:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:0.0:1788837941.493503:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+9:10290:x1875732240296704:12345-192.168.204.54@tcp:36:lfs.0 00010000:00010000:0.0:1788837941.493562:0:10730:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837941.493588:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e659b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cfd7 expref: 9 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.493610:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a448b3c200) 00010000:00010000:0.0:1788837941.493621:0:10730:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837941.493852:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e65f6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.493879:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e65f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.493900:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e65f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.493915:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e65fd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.493992:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e65fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.494000:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e65fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837941.497841:0:10730:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788837941.497862:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e65f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.497873:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e65f6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.497882:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e65f6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.497889:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e791600 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837941.497908:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e65f6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.497916:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e65f6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.497956:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a462b58500) 00010000:00010000:0.0:1788837941.497959:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837941.497965:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e65f6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.497972:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e65f6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788837941.497995:0:10730:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c8cec244 reply state 00000000c8a314bc transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e65fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837941.498004:0:10730:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788837941.498130:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+10:10290:x1875732240296704:12345-192.168.204.54@tcp:36:lfs.0 Request processed in 4624us (4867us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788837941.498139:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 37 00010000:00010000:3.0:1788837941.510928:0:3257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e65fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.510948:0:3257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e65fd lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.510956:0:3257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e65fd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.510963:0:3257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e791400 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837941.510967:0:3257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e65fd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.510975:0:3257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e65fd lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.510993:0:3257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff97a462b58700) 00010000:00010000:3.0:1788837941.510997:0:3257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837941.511002:0:3257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e65fd lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.511008:0:3257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e65fd lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837941.637909:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837941.638308:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240296832 00000100:00100000:0.0:1788837941.638319:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240296832 00000100:00100000:0.0:1788837941.638385:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:0.0:1788837941.638395:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+9:10299:x1875732240296832:12345-192.168.204.54@tcp:101:lctl.0 00010000:00010000:0.0:1788837941.638422:0:7972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837941.638450:0:7972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e6604 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0cff3 expref: -99 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.638517:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e660b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.638532:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e660b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.638555:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e660b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837941.638597:0:7972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788837941.638601:0:7972:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788837941.638640:0:7972:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e660b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.638667:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e6604 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cff3 expref: 11 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.638684:0:7972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e660b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cff3 expref: 10 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.638692:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a462b58500) 00010000:00010000:0.0:1788837941.638695:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788837941.638699:0:7972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e791400, rc 0) 00000100:00100000:0.0:1788837941.638770:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+10:10299:x1875732240296832:12345-192.168.204.54@tcp:101:lctl.0 Request processed in 376us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837941.638777:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:0.0:1788837941.742012:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837941.742249:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240296960 00000100:00100000:3.0:1788837941.742263:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240296960 00000100:00100000:3.0:1788837941.742330:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:3.0:1788837941.742342:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+10:10305:x1875732240296960:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1788837941.742366:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837941.742394:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e6612 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0cffa expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.742474:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6619 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.742490:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6619 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.742501:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6619 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.742516:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48aa00/0x2deb895b363e6620 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.742522:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48aa00/0x2deb895b363e6620 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.742529:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48aa00/0x2deb895b363e6620 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.742624:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b600/0x2deb895b363e6627 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.742633:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b600/0x2deb895b363e6627 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.742660:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b600/0x2deb895b363e6627 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837941.742690:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788837941.742693:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788837941.742746:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b600/0x2deb895b363e6627 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.742759:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6619 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.742765:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6619 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.742772:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6619 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.742778:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48b200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837941.742782:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6619 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.742790:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6619 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.742801:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a462b58500) 00010000:00010000:3.0:1788837941.742804:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837941.742807:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6619 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.742813:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6619 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.742836:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48aa00/0x2deb895b363e6620 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.742842:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48aa00/0x2deb895b363e6620 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.742858:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48aa00/0x2deb895b363e6620 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.742863:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48aa00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837941.742866:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48aa00/0x2deb895b363e6620 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.742872:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48aa00/0x2deb895b363e6620 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.742879:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff97a460c5e400) 00010000:00010000:3.0:1788837941.742882:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837941.742884:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48aa00/0x2deb895b363e6620 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.742908:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48aa00/0x2deb895b363e6620 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.742939:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e6612 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cffa expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.742953:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b600/0x2deb895b363e6627 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cffa expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.742972:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:3.0:1788837941.742975:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788837941.742977:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48b600, rc 0) 00000100:00100000:3.0:1788837941.743057:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+11:10305:x1875732240296960:12345-192.168.204.54@tcp:101:bash.0 Request processed in 716us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837941.743065:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:1.0:1788837941.746592:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837941.747881:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240297216 00000100:00100000:3.0:1788837941.747913:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240297216 00000100:00100000:3.0:1788837941.747980:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:3.0:1788837941.747991:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+11:10305:x1875732240297216:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1788837941.748012:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837941.748035:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e662e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d001 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.748438:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e6635 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.748456:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e6635 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.748469:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e6635 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.748484:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e663c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.748491:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e663c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.748518:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e663c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788837941.751402:0:5809:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788837941.751630:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6643 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.751649:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6643 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.751660:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6643 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.751693:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e6635 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.751699:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e6635 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.751705:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e6635 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.751710:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48be00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837941.751715:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e6635 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.751721:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e6635 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.751733:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:3.0:1788837941.751736:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837941.751753:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e6635 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.751759:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e6635 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788837941.751772:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000034ba6ad reply state 0000000085a291a2 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e663c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837941.751781:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788837941.751819:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e662e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d001 expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.751834:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6643 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d001 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.751841:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a460c5e700) 00010000:00010000:3.0:1788837941.751843:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837941.751845:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48ba00, rc 0) 00000100:00100000:3.0:1788837941.751945:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+14:10305:x1875732240297216:12345-192.168.204.54@tcp:101:bash.0 Request processed in 3956us (5365us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788837941.751955:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 40 00010000:00010000:3.0:1788837941.756195:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e663c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.756248:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e663c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.756257:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e663c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.756282:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48a200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837941.756288:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e663c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.756297:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e663c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.756315:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a460c5e800) 00010000:00010000:3.0:1788837941.756319:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837941.756324:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e663c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.756330:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e663c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837941.757021:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837941.757498:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240297344 00000100:00100000:3.0:1788837941.757508:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240297344 00000100:00100000:3.0:1788837941.757553:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:3.0:1788837941.757561:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1875732240297344:12345-192.168.204.54@tcp:8:bash.0 00010000:00080000:3.0:1788837941.757594:0:6650:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7@192.168.204.54@tcp t0 exp 0000000000000000 cur 321 last 0 00000020:00000080:3.0:1788837941.757628:0:6650:0:(genops.c:1385:class_connect()) connect: client f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7, cookie 0x2deb895b363e6651 00002000:00100000:3.0:1788837941.757640:0:6650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7/ffff97a46e75e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113975 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788837941.757662:0:6650:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788837941.759043:0:6650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788837941.759327:0:6650:0:(import.c:65:import_set_state_nolock()) ffff97a46e75b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837941.759405:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2348:x1875732240297344:12345-192.168.204.54@tcp:8:bash.0 Request processed in 1841us (2387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837941.759433:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:2.0:1788837941.775501:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837941.775603:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240297472 00000100:00100000:1.0:1788837941.775614:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240297472 00000100:00100000:1.0:1788837941.775709:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:1.0:1788837941.775719:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:0:x1875732240297472:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1788837941.775737:0:6652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837941.775761:0:6652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083c7ef4f/0x2deb895b363e6658 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d008 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788837941.775798:0:6652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788837941.775820:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=321s v=(0 0) 00010000:00010000:1.0:1788837941.775825:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837941.775834:0:6652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083c7ef4f/0x2deb895b363e6658 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d008 expref: 7 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837941.775856:0:6652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000083c7ef4f/0x2deb895b363e6658 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d008 expref: 7 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837941.775871:0:6652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3d800, rc 0) 00000100:00100000:1.0:1788837941.775947:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:0:x1875732240297472:12345-192.168.204.54@tcp:101:bash.0 Request processed in 229us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837941.775954:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00080000:0.0:1788837941.776692:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788837941.783038:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837941.783392:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240297600 00000100:00100000:1.0:1788837941.783403:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240297600 00000100:00100000:1.0:1788837941.783476:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:1.0:1788837941.783486:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:10305:x1875732240297600:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1788837941.783508:0:6653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837941.783528:0:6653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce15286d/0x2deb895b363e665f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d00f expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837941.783585:0:6653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000083c7ef4f/0x2deb895b363e6658 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d008 expref: 8 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837941.783594:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837941.783598:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837941.783604:0:6653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce15286d/0x2deb895b363e665f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d00f expref: 8 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837941.783640:0:6653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000083c7ef4f/0x2deb895b363e6658 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d008 expref: 8 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837941.783654:0:6653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000083c7ef4f/0x2deb895b363e6658 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d008 expref: 8 pid: 6652 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837941.783669:0:6653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459204700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6653:1875732255012864:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788837941.783784:0:6653:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a3476e69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837941.786857:0:6653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459204700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6653:1875732255012864:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788837941.786908:0:6653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ce15286d/0x2deb895b363e665f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d00f expref: 8 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837941.786930:0:6653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3ca00, rc 0) 00000100:00100000:1.0:1788837941.787008:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:10305:x1875732240297600:12345-192.168.204.54@tcp:101:bash.0 Request processed in 3522us (3981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837941.787017:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:2.0:1788837941.788143:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837941.788254:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240297728 00000100:00100000:0.0:1788837941.788263:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240297728 00010000:00010000:0.0:1788837941.788298:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000083c7ef4f/0x2deb895b363e6658 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d008 expref: 8 pid: 6652 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837941.788343:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:0.0:1788837941.788353:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:2351:x1875732240297728:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837941.788368:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837941.788390:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000083c7ef4f/0x2deb895b363e6658 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d008 expref: 8 pid: 6652 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.788403:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000083c7ef4f/0x2deb895b363e6658 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d008 expref: 8 pid: 6652 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.788434:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083c7ef4f/0x2deb895b363e6658 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d008 expref: 8 pid: 6652 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.788450:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837941.788454:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837941.788462:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce15286d/0x2deb895b363e665f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d00f expref: 7 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.788488:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce15286d/0x2deb895b363e665f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d00f expref: 7 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.788526:0:5794:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ce15286d/0x2deb895b363e665f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d00f expref: 7 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837941.788540:0:5794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5794:1875732255012992:192.168.204.54@tcp:105: 00000100:00100000:0.0:1788837941.788625:0:5794:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b66ed80 going to sleep for 11 seconds 00010000:00010000:0.0:1788837941.794573:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837941.802583:0:5794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5794:1875732255012992:192.168.204.54@tcp:105: 00010000:00010000:3.0:1788837941.802613:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837941.802692:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2351:x1875732240297728:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 14340us (14553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837941.802703:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:3.0:1788837941.810495:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837941.810606:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240297984 00000100:00100000:2.0:1788837941.810616:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240297984 00000100:00100000:2.0:1788837941.810681:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:2.0:1788837941.810691:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+13:10305:x1875732240297984:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:2.0:1788837941.811435:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+14:10305:x1875732240297984:12345-192.168.204.54@tcp:35:bash.0 Request processed in 742us (948us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788837941.811444:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:3.0:1788837941.921675:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837941.921835:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240298240 00000100:00100000:1.0:1788837941.921845:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240298240 00000100:00100000:1.0:1788837941.921919:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:1.0:1788837941.921930:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+14:10315:x1875732240298240:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788837941.921956:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837941.921977:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6666 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d016 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837941.922071:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788837941.922255:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6666 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d016 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837941.922271:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a462b58500) 00010000:00010000:1.0:1788837941.922274:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788837941.922279:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6666 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d016 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837941.922295:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3c600, rc 0) 00000100:00100000:1.0:1788837941.922351:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+15:10315:x1875732240298240:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 423us (685us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1788837941.922358:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:0.0:1788837941.926426:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837941.926664:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240298496 00000100:00100000:2.0:1788837941.926679:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240298496 00000100:00100000:2.0:1788837941.926769:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:2.0:1788837941.926781:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+15:10315:x1875732240298496:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788837941.927059:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+16:10315:x1875732240298496:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 279us (648us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788837941.927067:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:3.0:1788837942.032340:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837942.032498:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240298624 00000100:00100000:2.0:1788837942.032508:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240298624 00000100:00100000:2.0:1788837942.032573:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:2.0:1788837942.032584:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+16:10321:x1875732240298624:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788837942.032622:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837942.032645:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6674 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d01d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.032734:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e667b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.032748:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e667b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.032761:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e667b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837942.032795:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788837942.032799:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837942.032817:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e667b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.032842:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6674 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d01d expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.032860:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e667b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d01d expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.032868:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:2.0:1788837942.032871:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788837942.032876:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4000, rc 0) 00000100:00100000:2.0:1788837942.032949:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+17:10321:x1875732240298624:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 367us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837942.032956:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:3.0:1788837942.045598:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837942.045707:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240298880 00000100:00100000:1.0:1788837942.045717:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240298880 00000100:00100000:1.0:1788837942.045778:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:1.0:1788837942.045788:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+17:10321:x1875732240298880:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788837942.045807:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837942.045828:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6682 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d024 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.045949:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d800/0x2deb895b363e6689 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.045963:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d800/0x2deb895b363e6689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.045974:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d800/0x2deb895b363e6689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837942.045984:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788837942.046113:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6682 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d024 expref: 20 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.046132:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d800/0x2deb895b363e6689 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d024 expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.046140:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a460c5e700) 00010000:00010000:1.0:1788837942.046143:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837942.046147:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3d800, rc 0) 00000100:00100000:1.0:1788837942.046256:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+19:10321:x1875732240298880:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 469us (667us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788837942.046263:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:3.0:1788837942.054354:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837942.054472:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240299136 00000100:00100000:0.0:1788837942.054483:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240299136 00000100:00100000:0.0:1788837942.054553:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:0.0:1788837942.054565:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+19:10321:x1875732240299136:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788837942.054593:0:10730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837942.054613:0:10730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6697 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d02b expref: -99 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.054714:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e669e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.054728:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e669e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.054739:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e669e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837942.054751:0:10730:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788837942.054868:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6697 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d02b expref: 22 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.054898:0:10730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e669e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d02b expref: 21 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.054906:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a460c5e700) 00010000:00010000:0.0:1788837942.054909:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788837942.054926:0:10730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e791e00, rc 0) 00000100:00100000:0.0:1788837942.054985:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+21:10321:x1875732240299136:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 423us (641us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788837942.054991:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:3.0:1788837942.055975:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837942.056074:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240299264 00000100:00100000:1.0:1788837942.056081:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240299264 00000100:00100000:1.0:1788837942.056136:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:1.0:1788837942.056145:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+21:2352:x1875732240299264:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837942.056169:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837942.056199:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d800/0x2deb895b363e6689 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d024 expref: 21 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.056253:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a460c5e700) 00010000:00010000:1.0:1788837942.056257:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837942.056305:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+20:2352:x1875732240299264:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 161us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837942.056312:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:3.0:1788837942.065442:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837942.065558:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240299392 00000100:00100000:1.0:1788837942.065568:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240299392 00000100:00100000:1.0:1788837942.065636:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:1.0:1788837942.065647:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2350:x1875732240299392:12345-192.168.204.54@tcp:1:lfs.0 00010000:00010000:1.0:1788837942.065696:0:6652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083c7ef4f/0x2deb895b363e66ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.065717:0:6652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce15286d/0x2deb895b363e665f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d00f expref: 7 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.065726:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788837942.065730:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837942.065735:0:6652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083c7ef4f/0x2deb895b363e66ac lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.065770:0:6652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ce15286d/0x2deb895b363e665f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d00f expref: 7 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.065785:0:6652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ce15286d/0x2deb895b363e665f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d00f expref: 7 pid: 6653 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837942.065814:0:6652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459204700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6652:1875732255013120:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788837942.065932:0:6652:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a3476e69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837942.070766:0:6652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459204700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6652:1875732255013120:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788837942.070802:0:6652:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000083c7ef4f/0x2deb895b363e66ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837942.073255:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837942.073422:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240299520 00000100:00100000:1.0:1788837942.073432:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240299520 00002000:00100000:1.0:1788837942.073493:0:6656:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff97a46f4d2300 x1875732240299520/t0(0) o4->f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7@192.168.204.54@tcp:598/0 lens 504/0 e 0 to 0 dl 1788837953 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788837942.073505:0:6656:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a46f4d2300 with x1875732240299520 ext(0->12) 00010000:00010000:1.0:1788837942.073515:0:6656:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ce15286d/0x2deb895b363e665f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d00f expref: 8 pid: 6653 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.073533:0:6656:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ce15286d/0x2deb895b363e665f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d00f expref: 8 pid: 6653 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788837942.073542:0:6656:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff97a46f4d2300 00000100:00100000:1.0:1788837942.073576:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:1.0:1788837942.073587:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:2351:x1875732240299520:12345-192.168.204.54@tcp:4:lfs.0 00000001:00100000:3.0:1788837942.115467:0:7611:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7 00000001:00080000:0.0:1788837942.143541:0:7611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:1.0:1788837942.143624:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2351:x1875732240299520:12345-192.168.204.54@tcp:4:lfs.0 Request processed in 70032us (70374us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788837942.143637:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00002000:00100000:1.0:1788837942.143659:0:6656:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff97a46f4d2300 x1875732240299520/t4294967299(0) o4->f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7@192.168.204.54@tcp:598/0 lens 504/448 e 0 to 0 dl 1788837953 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788837942.143669:0:6656:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a46f4d2300 with x1875732240299520 ext(0->12) 00010000:00010000:1.0:1788837942.143679:0:6656:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ce15286d/0x2deb895b363e665f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d00f expref: 7 pid: 6653 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.143694:0:6656:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ce15286d/0x2deb895b363e665f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d00f expref: 7 pid: 6653 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788837942.143701:0:6656:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff97a46f4d2300 00000100:00100000:3.0:1788837942.146734:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837942.146835:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240299648 00000100:00100000:1.0:1788837942.146844:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240299648 00010000:00010000:1.0:1788837942.146894:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ce15286d/0x2deb895b363e665f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d00f expref: 7 pid: 6653 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837942.146973:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:1.0:1788837942.146984:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2349:x1875732240299648:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837942.146999:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788837942.147019:0:5795:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788837942.147022:0:5795:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788837940 00002000:00010000:1.0:1788837942.147025:0:5795:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788837941 00002000:00010000:1.0:1788837942.147027:0:5795:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788837940 00002000:00010000:1.0:1788837942.147029:0:5795:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1788837942.147035:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ce15286d/0x2deb895b363e665f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d00f expref: 7 pid: 6653 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.147078:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ce15286d/0x2deb895b363e665f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d00f expref: 7 pid: 6653 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.147104:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce15286d/0x2deb895b363e665f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d00f expref: 7 pid: 6653 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.147124:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837942.147128:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837942.147134:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000083c7ef4f/0x2deb895b363e66ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.147143:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083c7ef4f/0x2deb895b363e66ac lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.147178:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837942.147286:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2349:x1875732240299648:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 303us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837942.147294:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 36 00010000:00010000:0.0:1788837942.147681:0:6652:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000083c7ef4f/0x2deb895b363e66ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.147692:0:6652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083c7ef4f/0x2deb895b363e66ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.147717:0:6652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083c7ef4f/0x2deb895b363e66ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.147726:0:6652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083c7ef4f/0x2deb895b363e66ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.147734:0:6652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083c7ef4f/0x2deb895b363e66ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.147741:0:6652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3d800 already unused, calling callback (ffffffffc1616420) 00010000:00010000:0.0:1788837942.147746:0:6652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083c7ef4f/0x2deb895b363e66ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.147755:0:6652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083c7ef4f/0x2deb895b363e66ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.147781:0:6652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083c7ef4f/0x2deb895b363e66ac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.147789:0:6652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083c7ef4f/0x2deb895b363e66ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837942.147842:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2350:x1875732240299392:12345-192.168.204.54@tcp:1:lfs.0 Request processed in 82195us (82411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837942.147850:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:3.0:1788837942.150759:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837942.151164:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240299904 00000100:00100000:0.0:1788837942.151173:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240299904 00000100:00100000:0.0:1788837942.151554:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:0.0:1788837942.151565:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+20:10321:x1875732240299904:12345-192.168.204.54@tcp:35:lfs.0 00000004:00010000:0.0:1788837942.151628:0:5811:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e669e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d02b expref: 20 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788837942.151919:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1788837942.151974:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1788837942.153022:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1788837942.153450:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e66b3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.153469:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6643 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d001 expref: 24 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.153479:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e66b3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.153529:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6643 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d001 expref: 24 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.153546:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6643 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d001 expref: 24 pid: 5809 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837942.153561:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5811:1875732255013248:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788837942.153661:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b66e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837942.157815:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837942.158462:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240300032 00000100:00100000:1.0:1788837942.158472:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240300032 00010000:00010000:1.0:1788837942.158515:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6643 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d001 expref: 25 pid: 5809 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837942.158563:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:1.0:1788837942.158573:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+25:2351:x1875732240300032:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837942.158603:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837942.158610:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6643 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d001 expref: 25 pid: 5809 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.158623:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6643 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d001 expref: 25 pid: 5809 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.158647:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a460c5e700) 00010000:00010000:1.0:1788837942.158653:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e66b3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.158662:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e66b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.158669:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e66b3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.158687:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837942.158789:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+25:2351:x1875732240300032:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 217us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837942.158797:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 37 00010000:00010000:0.0:1788837942.159721:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6643 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d001 expref: 24 pid: 5809 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837942.159742:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5811:1875732255013248:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788837942.159770:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e66b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.159780:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e66b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.159785:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e66b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788837942.160123:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1788837942.162179:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1788837942.165578:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459204700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5811:1875732255013376:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788837942.165653:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837942.165735:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448e43240 going to sleep for 11 seconds 00000100:00100000:3.0:1788837942.165783:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255013376 00000100:00100000:3.0:1788837942.165791:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255013376 00000100:00100000:3.0:1788837942.165897:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788837942.165907:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5811:x1875732255013376:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788837942.165987:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5811:x1875732255013376:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 81us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837942.165995:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788837942.166093:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459204700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5811:1875732255013376:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788837942.166703:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1788837942.166767:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a459204700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5811:1875732255013504:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788837942.166816:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837942.166853:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4618bb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837942.167197:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255013504 00000100:00100000:3.0:1788837942.167239:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255013504 00000100:00100000:3.0:1788837942.167269:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788837942.167276:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46019ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5811:x1875732255013504:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788837942.167475:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46019ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5811:x1875732255013504:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 199us (658us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788837942.167482:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788837942.167727:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a459204700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5811:1875732255013504:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788837942.167776:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1788837942.167815:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e66b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.167826:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e66b3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.167834:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e66b3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.167840:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e790200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837942.167845:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e66b3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.167853:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e66b3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.167869:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a460c5e700) 00010000:00010000:2.0:1788837942.167873:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788837942.167890:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e66b3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.167897:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e66b3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788837942.168328:0:5811:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788837942.168534:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788837942.168555:0:5811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 322262351772ns, next at 323262349227ns, rc = 0 00000001:00080000:2.0:1788837942.168563:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1788837942.168599:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a460c5e700) 00010000:00010000:2.0:1788837942.168602:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788837942.168609:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e669e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d02b expref: 28 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837942.168719:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+27:10321:x1875732240299904:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 17156us (17968us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788837942.168728:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000020:00080000:2.0:1788837942.168732:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788837942.171772:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837942.171834:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240300160 00000100:00100000:1.0:1788837942.171844:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240300160 00000100:00100000:1.0:1788837942.171911:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:1.0:1788837942.171921:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+27:10321:x1875732240300160:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788837942.171954:0:7972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837942.171977:0:7972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e66ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d032 expref: -99 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.172039:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e66ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d032 expref: 28 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.172053:0:7972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e66ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d032 expref: 28 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.172083:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a45487f600) 00010000:00010000:1.0:1788837942.172086:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788837942.172090:0:7972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3ca00, rc 0) 00000100:00080000:0.0:1788837942.172189:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837942.172635:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+28:10321:x1875732240300160:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 714us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837942.172643:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:3.0:1788837942.176369:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837942.176530:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240300416 00000100:00100000:2.0:1788837942.176540:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240300416 00000100:00100000:2.0:1788837942.176603:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:2.0:1788837942.176613:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4713ae450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+28:10321:x1875732240300416:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788837942.176859:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4713ae450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+29:10321:x1875732240300416:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 245us (499us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1788837942.176866:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:2.0:1788837942.263349:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837942.263725:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240300672 00000100:00100000:1.0:1788837942.263738:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240300672 00000100:00100000:1.0:1788837942.263962:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:1.0:1788837942.263984:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46019ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+29:10331:x1875732240300672:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788837942.264009:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837942.264031:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e66c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d039 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837942.264121:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788837942.264297:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e66c1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d039 expref: 31 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.264328:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a462b58500) 00010000:00010000:1.0:1788837942.264332:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788837942.264338:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e66c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d039 expref: 31 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.264352:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3c600, rc 0) 00000100:00100000:1.0:1788837942.264419:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46019ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+30:10331:x1875732240300672:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 438us (1083us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1788837942.264426:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:0.0:1788837942.268992:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837942.271243:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240300800 00000100:00100000:2.0:1788837942.271259:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240300800 00000100:00100000:2.0:1788837942.271320:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:2.0:1788837942.271329:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+30:10331:x1875732240300800:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:2.0:1788837942.271401:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e66cf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.271418:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e66cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.271449:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e66cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.271463:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e66d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.271470:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e66d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.271477:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e66d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.271563:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e66dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.271571:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e66dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.271577:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e66dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837942.271628:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e66dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.271640:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e66cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.271647:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e66cf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.271655:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e66cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.271670:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837942.271675:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e66cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.271682:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e66cf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.271695:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:2.0:1788837942.271698:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837942.271702:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e66cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.271708:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e66cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.271720:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e66d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.271726:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e66d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.271732:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e66d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.271737:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5a00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837942.271740:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e66d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.271745:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e66d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.271759:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a448b3ce00) 00010000:00010000:2.0:1788837942.271761:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837942.271764:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e66d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.271769:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e66d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.271781:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e66dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.271787:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e66dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.271792:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e66dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.271797:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4c00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837942.271800:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e66dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.271806:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e66dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.271812:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a45487f600) 00010000:00010000:2.0:1788837942.271814:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837942.271817:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e66dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.271822:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e66dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837942.272928:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+30:10331:x1875732240300800:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 1593us (4336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837942.272939:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:2.0:1788837942.277355:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837942.277435:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240301056 00000100:00100000:1.0:1788837942.277446:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240301056 00000100:00100000:1.0:1788837942.277514:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:1.0:1788837942.277524:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46019f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+30:10331:x1875732240301056:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1788837942.277757:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46019f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+31:10331:x1875732240301056:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 233us (411us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788837942.277764:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:3.0:1788837942.368184:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837942.368511:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240301312 00000100:00100000:1.0:1788837942.368522:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240301312 00000100:00100000:1.0:1788837942.368581:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:1.0:1788837942.368590:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+31:10334:x1875732240301312:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788837942.368615:0:7972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837942.368636:0:7972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e66e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d040 expref: -99 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.368708:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e66eb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.368736:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e66eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.368747:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e66eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.368763:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e66f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.368770:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e66f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.368776:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e66f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.368907:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e66f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.368916:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e66f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.368923:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e66f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837942.368932:0:7972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788837942.369042:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e66eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.369051:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e66eb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.369291:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e66eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.369305:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3c000 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837942.369310:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e66eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.369318:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e66eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.369332:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:1.0:1788837942.369335:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837942.369339:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e66eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.369346:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e66eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.369360:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e66f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.369366:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e66f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.369373:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e66f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.369378:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3c400 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837942.369380:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e66f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.369386:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e66f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.369402:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a45487fb00) 00010000:00010000:1.0:1788837942.369404:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837942.369407:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e66f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.369413:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e66f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.369451:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e66e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d040 expref: 34 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.369465:0:7972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e66f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d040 expref: 33 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.369473:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a45487f600) 00010000:00010000:1.0:1788837942.369475:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837942.369477:0:7972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3d200, rc 0) 00000100:00100000:1.0:1788837942.369592:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+33:10334:x1875732240301312:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1002us (1417us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1788837942.369599:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:0.0:1788837942.373444:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837942.373507:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240301440 00000100:00100000:1.0:1788837942.373518:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240301440 00000100:00100000:1.0:1788837942.373581:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:1.0:1788837942.373591:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+33:10334:x1875732240301440:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:1.0:1788837942.373661:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e6707 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.373679:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e6707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.373709:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e6707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.373739:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e6707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.373747:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e6707 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.373756:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e6707 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.373762:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3de00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837942.373766:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e6707 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.373774:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e6707 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.373786:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a45487f600) 00010000:00010000:1.0:1788837942.373790:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788837942.373796:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e6707 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.373802:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e6707 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837942.373901:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+33:10334:x1875732240301440:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 310us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837942.373909:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:2.0:1788837942.379317:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837942.380005:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240301696 00000100:00100000:0.0:1788837942.380016:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240301696 00000100:00100000:0.0:1788837942.380104:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:0.0:1788837942.380116:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46019d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+33:10334:x1875732240301696:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:0.0:1788837942.380408:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46019d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+34:10334:x1875732240301696:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 294us (1101us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788837942.380416:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:3.0:1788837942.434686:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837942.434905:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837942.434926:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732255013760:0@lo:400:kworker.0 00000100:00100000:2.0:1788837942.435002:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837942.436837:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255013760 00000100:00100000:1.0:1788837942.436884:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255013760 00000100:00100000:1.0:1788837942.436964:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788837942.436975:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3273:x1875732255013760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837942.437642:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3273:x1875732255013760:12345-0@lo:400:kworker.0 Request processed in 668us (2638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837942.437652:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1788837942.437758:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448b76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255013632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837942.439335:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732255013888:0@lo:400:kworker.0 00000100:00100000:2.0:1788837942.439618:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732255013760:0@lo:400:kworker.0 00000100:00100000:2.0:1788837942.439652:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255014144:0@lo:400:kworker.0 00000100:00100000:2.0:1788837942.439708:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837942.439749:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837942.439756:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732255014272:0@lo:400:kworker.0 00000100:00100000:2.0:1788837942.439783:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837942.439813:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255014144 00000100:00100000:2.0:1788837942.439820:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255014144 00000100:00100000:2.0:1788837942.439964:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788837942.439972:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46019c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255014144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837942.440021:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46019c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255014144:12345-0@lo:400:kworker.0 Request processed in 50us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837942.440028:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788837942.441487:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255014144:0@lo:400:kworker.0 00000100:00100000:2.0:1788837942.441673:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255014272 00000100:00100000:2.0:1788837942.441682:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255014272 00000100:00100000:2.0:1788837942.441769:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788837942.441777:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46019e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1875732255014272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837942.441855:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46019e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1875732255014272:12345-0@lo:400:kworker.0 Request processed in 79us (2071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837942.441863:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788837942.441914:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732255014272:0@lo:400:kworker.0 00000100:00100000:2.0:1788837942.441980:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3272:1875732255014016:0@lo:400:kworker.0 00000100:00100000:2.0:1788837942.442019:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837942.443187:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255014016 00000100:00100000:2.0:1788837942.443199:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255014016 00000100:00100000:2.0:1788837942.443277:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788837942.443287:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46019f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1875732255014016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837942.444178:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837942.444451:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837942.445436:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46019f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1875732255014016:12345-0@lo:400:kworker.0 Request processed in 2145us (3410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837942.445450:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788837942.445480:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255013888 00000100:00100000:2.0:1788837942.445488:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255013888 00000100:00100000:2.0:1788837942.452648:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3272:1875732255014016:0@lo:400:kworker.0 00000100:00100000:2.0:1788837942.452710:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788837942.452726:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732255013888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837942.452828:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732255013888:12345-0@lo:400:kworker.0 Request processed in 110us (8651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837942.452836:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:2.0:1788837942.452934:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788837942.452942:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837942.452969:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732255013888:0@lo:400:kworker.0 00000100:00100000:3.0:1788837942.458586:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255013632 00000100:00100000:3.0:1788837942.458603:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255013632 00000100:00100000:3.0:1788837942.458667:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788837942.458678:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3274:x1875732255013632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788837942.458703:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1788837942.458785:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3274:x1875732255013632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (14334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837942.458792:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788837942.459415:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448b76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255013632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837942.769993:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837942.770165:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240301952 00000100:00100000:2.0:1788837942.770178:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240301952 00000100:00100000:2.0:1788837942.770278:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:2.0:1788837942.770288:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+34:10365:x1875732240301952:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:2.0:1788837942.770313:0:10730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837942.770334:0:10730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e670e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d047 expref: -99 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.770453:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6715 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.770470:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.770481:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837942.770493:0:10730:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788837942.770662:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e670e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d047 expref: 37 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.770682:0:10730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6715 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d047 expref: 36 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.770692:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a45487f600) 00010000:00010000:2.0:1788837942.770701:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837942.770705:0:10730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5200, rc 0) 00000100:00100000:2.0:1788837942.770784:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+36:10365:x1875732240301952:12345-192.168.204.54@tcp:101:cat.0 Request processed in 496us (801us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788837942.770792:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:3.0:1788837942.777437:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837942.777501:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837942.777787:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240302336 00000100:00100000:1.0:1788837942.777798:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240302336 00000100:00100000:1.0:1788837942.777881:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:1.0:1788837942.777893:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4497d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+36:2350:x1875732240302336:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837942.777909:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837942.777934:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6715 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d047 expref: 36 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.777953:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a45487f600) 00010000:00010000:1.0:1788837942.777959:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837942.778018:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4497d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+35:2350:x1875732240302336:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 128us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837942.778025:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:0.0:1788837942.778904:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240302208 00000100:00100000:0.0:1788837942.778913:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240302208 00000100:00100000:0.0:1788837942.778961:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:0.0:1788837942.778970:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+35:10365:x1875732240302208:12345-192.168.204.54@tcp:35:cat.0 00000100:00100000:0.0:1788837942.779309:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+36:10365:x1875732240302208:12345-192.168.204.54@tcp:35:cat.0 Request processed in 339us (1884us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788837942.779316:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00010000:00010000:3.0:1788837942.819153:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837942.855063:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837942.855263:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240302592 00000100:00100000:2.0:1788837942.855279:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240302592 00000100:00100000:2.0:1788837942.855365:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:2.0:1788837942.855376:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+36:10371:x1875732240302592:12345-192.168.204.54@tcp:101:dd.0 00010000:00010000:2.0:1788837942.855402:0:7972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837942.855405:0:7972:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788837942.855432:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e667b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d01d expref: 36 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.855453:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:2.0:1788837942.855458:0:7972:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837942.855471:0:7972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6723 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d04e expref: -99 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.855920:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e672a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.855936:0:7972:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e66f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d040 expref: 36 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.855944:0:7972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e672a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.855976:0:7972:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e66f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d040 expref: 36 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.856010:0:7972:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e66f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d040 expref: 36 pid: 7972 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837942.856025:0:7972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46019ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7972:1875732255014400:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788837942.856139:0:7972:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4618bb480 going to sleep for 11 seconds 00000100:00100000:2.0:1788837942.860920:0:7972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46019ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7972:1875732255014400:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788837942.860973:0:7972:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e672a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837942.862150:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837942.862575:0:7599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240302720 00000100:00100000:2.0:1788837942.862693:0:7599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240302720 00010000:00010000:2.0:1788837942.862758:0:7599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e66f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d040 expref: 37 pid: 7972 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837942.862985:0:7599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:2.0:1788837942.862998:0:7599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+37:2351:x1875732240302720:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837942.863049:0:7599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837942.863058:0:7599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e66f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d040 expref: 37 pid: 7972 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.863168:0:7599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e66f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d040 expref: 37 pid: 7972 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.863199:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e66f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d040 expref: 37 pid: 7972 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.863343:0:7599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a45487f600) 00010000:00010000:2.0:1788837942.863350:0:7599:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e672a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.863361:0:7599:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e672a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.863371:0:7599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e672a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837942.863456:0:7599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837942.863534:0:7599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+36:2351:x1875732240302720:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 537us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837942.863542:0:7599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 38 00010000:00010000:1.0:1788837942.863970:0:7972:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e672a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.863982:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e672a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837942.864008:0:7972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788837942.864917:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6723 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d04e expref: 37 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.864970:0:7972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e672a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d04e expref: 36 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837942.864980:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a45487f600) 00010000:00010000:1.0:1788837942.864991:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788837942.864995:0:7972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5600, rc 0) 00000100:00100000:1.0:1788837942.865528:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+36:10371:x1875732240302592:12345-192.168.204.54@tcp:101:dd.0 Request processed in 9696us (10024us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1788837942.865539:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:3.0:1788837942.868017:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837942.870009:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240302976 00000100:00100000:0.0:1788837942.870028:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240302976 00000100:00100000:0.0:1788837942.870246:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:0.0:1788837942.870261:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+36:10371:x1875732240302976:12345-192.168.204.54@tcp:36:dd.0 00010000:00010000:0.0:1788837942.870957:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6738 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.870983:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6738 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.870995:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6738 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788837942.871145:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1788837942.871178:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000471bfcdf reply state 00000000466653a3 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6738 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837942.871188:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788837942.871374:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+39:10371:x1875732240302976:12345-192.168.204.54@tcp:36:dd.0 Request processed in 1115us (3370us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788837942.871383:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 52 00000020:00080000:0.0:1788837942.871389:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788837942.873359:0:3257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6738 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837942.873384:0:3257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6738 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837942.873392:0:3257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6738 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837942.873399:0:3257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e791000 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837942.873406:0:3257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6738 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837942.873414:0:3257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6738 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837942.873434:0:3257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a45487f600) 00010000:00010000:3.0:1788837942.873437:0:3257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837942.873442:0:3257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6738 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837942.873448:0:3257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6738 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837943.185881:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837943.188977:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240303104 00000100:00100000:0.0:1788837943.188998:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240303104 00000100:00100000:0.0:1788837943.189187:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:0.0:1788837943.189226:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+38:10385:x1875732240303104:12345-192.168.204.54@tcp:101:stat.0 00010000:00010000:0.0:1788837943.189258:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837943.189287:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e673f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d055 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.189374:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6746 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.189391:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6746 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.189405:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6746 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.189422:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e674d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.189451:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e674d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.189458:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e674d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.189915:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6754 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.189932:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e672a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d04e expref: 39 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.189941:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6754 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.189984:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e672a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d04e expref: 39 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.190002:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e672a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d04e expref: 39 pid: 7972 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837943.190018:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5810:1875732255014528:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788837943.190264:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b66e6c0 going to sleep for 11 seconds 00000100:00080000:2.0:1788837943.191321:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837943.200406:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5810:1875732255014528:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788837943.200456:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6754 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837943.200463:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837943.202101:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240303360 00000100:00100000:3.0:1788837943.202119:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240303360 00000100:00100000:3.0:1788837943.202474:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:3.0:1788837943.202488:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46019ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+40:5588:x1875732240303360:12345-192.168.204.54@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788837943.203131:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46019ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+41:5588:x1875732240303360:12345-192.168.204.54@tcp:35:ldlm_bl.0 Request processed in 643us (2666us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1788837943.203165:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:2.0:1788837943.205696:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837943.205821:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240303488 00000100:00100000:1.0:1788837943.205835:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240303488 00010000:00010000:1.0:1788837943.205902:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e672a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d04e expref: 41 pid: 7972 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837943.205988:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:1.0:1788837943.206000:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46019d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+41:2352:x1875732240303488:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837943.206023:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837943.206032:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e672a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d04e expref: 41 pid: 7972 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.206057:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e672a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d04e expref: 41 pid: 7972 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.206092:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e672a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d04e expref: 41 pid: 7972 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.206134:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a45487f600) 00010000:00010000:1.0:1788837943.206141:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6754 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.206151:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.206160:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6754 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.206250:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837943.206321:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46019d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+40:2352:x1875732240303488:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 323us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837943.206329:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 39 00010000:00010000:0.0:1788837943.206530:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.206546:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837943.206609:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788837943.206614:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788837943.206686:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.206703:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.206714:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6746 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.206720:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6746 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.206728:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6746 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.206735:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e791e00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837943.206740:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6746 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.206749:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6746 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.206761:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:0.0:1788837943.206764:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837943.206768:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6746 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.206784:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6746 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.206799:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e674d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.206806:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e674d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.206811:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e674d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.206816:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e790200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837943.206819:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e674d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.206825:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e674d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.206833:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a462b58100) 00010000:00010000:0.0:1788837943.206836:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837943.206840:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e674d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.206846:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e674d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.206903:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e673f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d055 expref: 40 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.206920:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6754 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d055 expref: 39 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.206935:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a45487f600) 00010000:00010000:0.0:1788837943.206937:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837943.206940:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e791c00, rc 0) 00000100:00100000:0.0:1788837943.206977:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+39:10385:x1875732240303104:12345-192.168.204.54@tcp:101:stat.0 Request processed in 17780us (21122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837943.206985:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:0.0:1788837943.272544:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837943.273328:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240303744 00000100:00100000:1.0:1788837943.273342:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240303744 00000100:00100000:1.0:1788837943.273447:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:1.0:1788837943.273461:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+39:10391:x1875732240303744:12345-192.168.204.54@tcp:36:truncate.0 00010000:00010000:1.0:1788837943.273543:0:7972:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837943.273583:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6754 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d055 expref: 39 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.273610:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a45487f600) 00010000:00010000:1.0:1788837943.273616:0:7972:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788837943.273925:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e675b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.273944:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e675b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.273974:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e675b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788837943.274055:0:7972:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1788837943.274082:0:7972:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008bc5542c reply state 00000000f40cd42d transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e675b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837943.274093:0:7972:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788837943.274331:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+41:10391:x1875732240303744:12345-192.168.204.54@tcp:36:truncate.0 Request processed in 870us (1800us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788837943.274340:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 54 00000020:00080000:1.0:1788837943.274346:0:7972:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788837943.281867:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e675b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837943.281891:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e675b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837943.281900:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e675b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837943.281907:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3de00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837943.281913:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e675b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837943.281922:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e675b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837943.281945:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a45487f600) 00010000:00010000:3.0:1788837943.281949:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837943.281955:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e675b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837943.281962:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e675b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837943.409842:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837943.409996:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240303872 00000100:00100000:2.0:1788837943.410011:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240303872 00000100:00100000:2.0:1788837943.410134:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:2.0:1788837943.410148:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+40:10405:x1875732240303872:12345-192.168.204.54@tcp:101:stat.0 00010000:00010000:2.0:1788837943.410194:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837943.410250:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6762 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d05c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.410341:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e6769 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.410384:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e6769 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.410398:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e6769 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.410421:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6770 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.410429:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.410436:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.410562:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6777 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.410570:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6777 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.410767:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6777 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837943.410816:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788837943.410821:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837943.410849:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6777 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.410875:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6777 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.410897:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e6769 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.410904:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e6769 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.410912:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e6769 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.410919:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4600 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837943.410924:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e6769 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.410934:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e6769 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.410950:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:2.0:1788837943.410953:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837943.410959:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e6769 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.410965:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e6769 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.410981:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.410988:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6770 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.410994:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6770 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.411005:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5600 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837943.411008:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6770 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.411014:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6770 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.411023:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a448b3ce00) 00010000:00010000:2.0:1788837943.411025:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837943.411028:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6770 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.411033:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6770 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.411071:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6762 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d05c expref: 42 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.411087:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6777 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d05c expref: 41 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.411095:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a45487f600) 00010000:00010000:2.0:1788837943.411098:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837943.411100:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5a00, rc 0) 00000100:00100000:2.0:1788837943.411551:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+41:10405:x1875732240303872:12345-192.168.204.54@tcp:101:stat.0 Request processed in 1402us (1720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837943.411917:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:3.0:1788837943.507727:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837943.507772:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837943.507796:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837943.507822:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837943.507864:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240304128 00000100:00100000:3.0:1788837943.507887:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240304128 00000100:00080000:1.0:1788837943.507928:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837943.507967:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:3.0:1788837943.507979:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2352:x1875732240304128:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788837943.508357:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2352:x1875732240304128:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 378us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837943.508366:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:3.0:1788837943.508398:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240304000 00000100:00100000:3.0:1788837943.508402:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240304000 00000100:00100000:3.0:1788837943.508431:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 291 00000100:00100000:3.0:1788837943.508438:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2352:x1875732240304000:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788837943.511094:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240304256 00000100:00100000:0.0:1788837943.511114:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240304256 00000100:00100000:0.0:1788837943.511224:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240304512 00000100:00100000:0.0:1788837943.511228:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240304512 00000100:00100000:0.0:1788837943.511262:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 141 00000100:00100000:0.0:1788837943.511274:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2352:x1875732240304256:12345-192.168.204.54@tcp:400:kworker.0 00000100:00080000:1.0:1788837943.511390:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837943.511412:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:1.0:1788837943.511424:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+41:10415:x1875732240304512:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788837943.511438:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837943.511465:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e677e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d063 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837943.511602:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788837943.511916:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e677e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d063 expref: 43 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.511934:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a462b58500) 00010000:00010000:1.0:1788837943.511937:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788837943.511943:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e677e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d063 expref: 43 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.511981:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3c400, rc 0) 00000100:00100000:3.0:1788837943.513235:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2352:x1875732240304000:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 4784us (5449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837943.513251:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 291 00000100:00100000:0.0:1788837943.513515:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2352:x1875732240304256:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 2241us (5714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837943.513525:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 141 00000100:00100000:0.0:1788837943.520054:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+42:10415:x1875732240304512:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 8613us (12209us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1788837943.520070:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:1.0:1788837943.522666:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837943.522769:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240304768 00000100:00100000:3.0:1788837943.522783:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240304768 00000100:00100000:3.0:1788837943.522845:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:3.0:1788837943.522870:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+42:10415:x1875732240304768:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1788837943.523389:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+43:10415:x1875732240304768:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 531us (733us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1788837943.523400:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000001:00080000:3.0:1788837943.532011:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967335 is committed 00000001:00080000:3.0:1788837943.532520:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967338 is committed 00000004:00080000:3.0:1788837943.532554:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788837943.532580:0:5830:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97a4618bb780 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788837943.532586:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a461712b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97a4618bb240 00000020:00080000:3.0:1788837943.532589:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a461712d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97a46e7a5400 00000100:00100000:2.0:1788837943.532864:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788837943.532898:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46019e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255014656:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788837943.532988:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837943.533088:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255014656 00000100:00100000:2.0:1788837943.533098:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255014656 00000100:00100000:2.0:1788837943.533165:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788837943.533175:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46019c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3272:x1875732255014656:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788837943.533242:0:6650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1788837943.533291:0:6650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9f8034, atime: 0x6a9f8035, ctime: 0x6a9f8034, blocks: 0xb 00010000:00010000:2.0:1788837943.533302:0:6650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d6d6ed7/0x2deb895b363e678c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.533325:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=323s v=(0 0) 00010000:00010000:2.0:1788837943.533330:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837943.533338:0:6650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d6d6ed7/0x2deb895b363e678c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.533361:0:6650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d6d6ed7/0x2deb895b363e678c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.533372:0:6650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d6d6ed7/0x2deb895b363e678c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.533380:0:6650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d6d6ed7/0x2deb895b363e678c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.533402:0:6650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788837943.534048:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46019c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3272:x1875732255014656:12345-0@lo:6:osp-syn-1-0.0 Request processed in 871us (1056us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788837943.534065:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1788837943.534102:0:7598:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837943.534109:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d6d6ed7/0x2deb895b363e678c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.534119:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4000 already unused, calling callback (ffffffffc1616420) 00010000:00010000:2.0:1788837943.534125:0:7598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d6d6ed7/0x2deb895b363e678c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.534136:0:7598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d6d6ed7/0x2deb895b363e678c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.534157:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d6d6ed7/0x2deb895b363e678c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.534163:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d6d6ed7/0x2deb895b363e678c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.534186:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837943.534188:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837943.534189:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788837943.534274:0:3272:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97a46019e300/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788837943.534281:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46019e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255014656:0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1788837943.534787:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1788837943.534912:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1788837943.577337:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837943.577815:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240305024 00000100:00100000:2.0:1788837943.577831:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240305024 00000100:00100000:2.0:1788837943.577927:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:2.0:1788837943.577940:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+13:10421:x1875732240305024:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788837943.577992:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837943.578023:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6793 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d06a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.578181:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e679a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.578247:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6777 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d05c expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.578260:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e679a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.578314:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6777 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d05c expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.578331:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6777 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d05c expref: 14 pid: 5809 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837943.578349:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46019df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5809:1875732255014784:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788837943.578483:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a461a643c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837943.584655:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837943.584862:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46019df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5809:1875732255014784:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788837943.584910:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e679a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837943.585061:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240305152 00000100:00100000:1.0:1788837943.585072:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240305152 00010000:00010000:1.0:1788837943.585123:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6777 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d05c expref: 15 pid: 5809 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837943.585168:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:1.0:1788837943.585188:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+15:2351:x1875732240305152:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837943.585466:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837943.585476:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6777 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d05c expref: 15 pid: 5809 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.585492:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6777 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d05c expref: 15 pid: 5809 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.585521:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6777 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d05c expref: 15 pid: 5809 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.585541:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a45487f600) 00010000:00010000:1.0:1788837943.585547:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e679a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.585582:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e679a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.585591:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e679a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.585623:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837943.585705:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+14:2351:x1875732240305152:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 527us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837943.585715:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 40 00010000:00010000:2.0:1788837943.585781:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e679a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.585789:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e679a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837943.585820:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788837943.586049:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6793 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d06a expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.586068:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e679a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d06a expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.586075:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a45487f600) 00010000:00010000:2.0:1788837943.586079:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788837943.586081:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5600, rc 0) 00000100:00100000:2.0:1788837943.586112:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+14:10421:x1875732240305024:12345-192.168.204.54@tcp:101:bash.0 Request processed in 8175us (8794us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788837943.586120:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:1.0:1788837943.589416:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837943.589574:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240305408 00000100:00100000:2.0:1788837943.589587:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240305408 00000100:00100000:2.0:1788837943.589662:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:2.0:1788837943.589674:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+14:10421:x1875732240305408:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:2.0:1788837943.590087:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e67a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.590110:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e67a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.590123:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e67a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788837943.590181:0:10730:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1788837943.590270:0:10730:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000690f0c5f reply state 0000000082144def transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e67a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837943.590282:0:10730:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788837943.590413:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+17:10421:x1875732240305408:12345-192.168.204.54@tcp:36:bash.0 Request processed in 739us (1008us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788837943.590421:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 58 00000020:00080000:2.0:1788837943.590427:0:10730:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788837943.592661:0:3257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e67a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.592685:0:3257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e67a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.592694:0:3257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e67a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.592702:0:3257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4600 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837943.592708:0:3257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e67a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.592719:0:3257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e67a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.592742:0:3257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a45487f600) 00010000:00010000:1.0:1788837943.592746:0:3257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837943.592752:0:3257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e67a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.592776:0:3257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e67a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837943.597050:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837943.597158:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240305536 00000100:00100000:0.0:1788837943.597171:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240305536 00000100:00100000:0.0:1788837943.597299:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:0.0:1788837943.597310:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+16:10421:x1875732240305536:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1788837943.597357:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837943.597387:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e67af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d071 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.597531:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e67b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.597551:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e679a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d06a expref: 17 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.597562:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e67b6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.597609:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e679a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d06a expref: 17 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.597625:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e679a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d06a expref: 17 pid: 5809 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837943.597643:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5808:1875732255014912:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788837943.597752:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b66ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1788837943.601422:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837943.601536:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240305664 00000100:00100000:2.0:1788837943.601549:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240305664 00010000:00010000:2.0:1788837943.601605:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e679a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d06a expref: 18 pid: 5809 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837943.601658:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:2.0:1788837943.601671:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+18:2351:x1875732240305664:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837943.601690:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837943.601698:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e679a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d06a expref: 18 pid: 5809 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.601714:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e679a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d06a expref: 18 pid: 5809 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.601745:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a45487f600) 00010000:00010000:2.0:1788837943.601752:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e67b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.601765:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e67b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.601775:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e67b6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.601820:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837943.601920:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+18:2351:x1875732240305664:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 251us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837943.601929:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 41 00010000:00010000:0.0:1788837943.602669:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e679a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d06a expref: 17 pid: 5809 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837943.602693:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5808:1875732255014912:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788837943.602720:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e67b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.602744:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e67b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.602751:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e67b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837943.602813:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788837943.602819:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788837943.602846:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e67b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.602895:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e67af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d071 expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.602912:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e67b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d071 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.602921:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a45487f600) 00010000:00010000:0.0:1788837943.602924:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837943.602928:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e791e00, rc 0) 00000100:00100000:0.0:1788837943.602991:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+16:10421:x1875732240305536:12345-192.168.204.54@tcp:101:bash.0 Request processed in 5682us (5965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837943.603000:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:3.0:1788837943.608636:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837943.608920:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240305920 00000100:00100000:1.0:1788837943.608935:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240305920 00000100:00100000:1.0:1788837943.609015:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:1.0:1788837943.609028:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4713afc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+16:10421:x1875732240305920:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:1.0:1788837943.609719:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4713afc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+17:10421:x1875732240305920:12345-192.168.204.54@tcp:35:bash.0 Request processed in 689us (1096us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1788837943.609731:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:3.0:1788837943.686264:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837943.686476:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240306176 00000100:00100000:2.0:1788837943.686492:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240306176 00000100:00100000:2.0:1788837943.686572:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:2.0:1788837943.686586:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+17:10431:x1875732240306176:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788837943.686628:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837943.686663:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e67bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d078 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837943.686805:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788837943.686994:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e67bd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d078 expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.687013:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a462b58500) 00010000:00010000:2.0:1788837943.687016:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788837943.687023:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e67bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d078 expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.687040:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4000, rc 0) 00000100:00100000:2.0:1788837943.687130:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+18:10431:x1875732240306176:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 547us (942us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1788837943.687138:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:0.0:1788837943.691971:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837943.692478:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240306304 00000100:00100000:1.0:1788837943.692496:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240306304 00000100:00100000:1.0:1788837943.692610:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:1.0:1788837943.692623:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+18:10431:x1875732240306304:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:1.0:1788837943.692737:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e67cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.692762:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e67cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.692779:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e67cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.692801:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e67d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.692808:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e67d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.692834:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e67d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.693409:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e67d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.693424:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e67d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.693433:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e67d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788837943.693495:0:7972:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e67d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.693511:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e67cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.693517:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e67cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.693524:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e67cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.693530:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3c800 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837943.693535:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e67cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.693543:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e67cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.693559:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:1.0:1788837943.693570:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837943.693577:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e67cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.693584:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e67cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.693602:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e67d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.693609:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e67d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.693616:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e67d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.693620:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3dc00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837943.693623:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e67d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.693629:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e67d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.693637:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a45487fb00) 00010000:00010000:1.0:1788837943.693640:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837943.693643:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e67d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.693648:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e67d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.693667:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e67d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.693680:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e67d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.693686:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e67d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.693692:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3ce00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837943.693696:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e67d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.693701:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e67d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.693709:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a45487f600) 00010000:00010000:1.0:1788837943.693712:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837943.693715:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e67d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.693720:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e67d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837943.693923:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+18:10431:x1875732240306304:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 1298us (1963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837943.693933:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:3.0:1788837943.696943:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837943.697022:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240306560 00000100:00100000:0.0:1788837943.697045:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240306560 00000100:00100000:0.0:1788837943.697119:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:0.0:1788837943.697131:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+18:10431:x1875732240306560:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:0.0:1788837943.697925:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+19:10431:x1875732240306560:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 790us (993us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1788837943.697936:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:2.0:1788837943.736883:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837943.738869:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240306816 00000100:00100000:0.0:1788837943.738889:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240306816 00000100:00100000:0.0:1788837943.739059:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:0.0:1788837943.739073:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46019df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+19:10434:x1875732240306816:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788837943.739109:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837943.739138:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e67e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d07f expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.739275:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e67e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.739294:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e67e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.739307:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e67e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.739325:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e67ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.739333:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e67ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.739340:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e67ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.739958:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e67f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.739979:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e67f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.739987:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e67f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837943.740048:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788837943.740382:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e67e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.740391:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e67e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.740399:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e67e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.740405:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e791c00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837943.740410:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e67e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.740418:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e67e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.740433:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:0.0:1788837943.740436:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837943.740441:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e67e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.740447:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e67e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.740470:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e67ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.740484:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e67ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.740490:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e67ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.740495:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e791a00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837943.740498:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e67ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.740504:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e67ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.740512:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a462b58100) 00010000:00010000:0.0:1788837943.740514:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837943.740517:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e67ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.740524:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e67ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.740574:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e67e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d07f expref: 22 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.740587:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e67f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d07f expref: 21 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.740594:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a45487f600) 00010000:00010000:0.0:1788837943.740597:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837943.740605:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e790000, rc 0) 00000100:00100000:0.0:1788837943.743861:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46019df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+21:10434:x1875732240306816:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 4759us (6963us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1788837943.743879:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:1.0:1788837943.750319:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837943.750539:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240307072 00000100:00100000:0.0:1788837943.750553:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240307072 00000100:00100000:0.0:1788837943.750641:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:0.0:1788837943.750654:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+21:10434:x1875732240307072:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:0.0:1788837943.750750:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6803 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.750772:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.750784:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.750821:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.750829:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6803 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.750837:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6803 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.750844:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e790200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837943.750859:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6803 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.750869:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6803 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.750904:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a45487f600) 00010000:00010000:0.0:1788837943.750907:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788837943.750919:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6803 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.750926:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6803 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837943.751034:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+21:10434:x1875732240307072:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 383us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837943.751043:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:3.0:1788837943.753960:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837943.754073:0:7599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240306944 00000100:00100000:2.0:1788837943.754087:0:7599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240306944 00000100:00100000:2.0:1788837943.754187:0:7599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:2.0:1788837943.754200:0:7599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+21:2351:x1875732240306944:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837943.754414:0:7599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837943.754447:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e67f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d07f expref: 21 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.754473:0:7599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a45487f600) 00010000:00010000:2.0:1788837943.754480:0:7599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837943.754560:0:7599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+20:2351:x1875732240306944:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 362us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837943.754568:0:7599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:3.0:1788837943.755133:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837943.755392:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240307328 00000100:00100000:2.0:1788837943.755402:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240307328 00000100:00100000:2.0:1788837943.755483:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:2.0:1788837943.755494:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+20:10434:x1875732240307328:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788837943.755806:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+21:10434:x1875732240307328:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 313us (674us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788837943.755815:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00010000:00010000:2.0:1788837943.842393:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837943.882829:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837943.883501:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240307584 00000100:00100000:1.0:1788837943.883516:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240307584 00000100:00100000:1.0:1788837943.883604:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:1.0:1788837943.883616:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+21:10452:x1875732240307584:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:1.0:1788837943.883673:0:7972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837943.883702:0:7972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e680a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d086 expref: -99 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.883843:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6811 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.883871:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6811 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.883885:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6811 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837943.883899:0:7972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788837943.884277:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e680a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d086 expref: 24 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.884314:0:7972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6811 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d086 expref: 23 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837943.884324:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a45487f600) 00010000:00010000:1.0:1788837943.884328:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788837943.884332:0:7972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3dc00, rc 0) 00000100:00100000:1.0:1788837943.884546:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+23:10452:x1875732240307584:12345-192.168.204.54@tcp:101:cat.0 Request processed in 930us (1731us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1788837943.884555:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:3.0:1788837943.913829:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837943.913978:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240307712 00000100:00100000:0.0:1788837943.913992:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240307712 00000100:00100000:0.0:1788837943.914091:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:0.0:1788837943.914105:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+23:10453:x1875732240307712:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788837943.914139:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837943.914170:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e681f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d08d expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.914331:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e6826 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.914349:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e6826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.914365:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e6826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837943.914409:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788837943.914427:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788837943.914463:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e6826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.914499:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e681f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d08d expref: 25 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.914520:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e6826 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d08d expref: 24 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837943.914531:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:0.0:1788837943.914535:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788837943.914539:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e791a00, rc 0) 00000100:00100000:0.0:1788837943.914614:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+24:10453:x1875732240307712:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 512us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837943.914621:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:3.0:1788837943.920427:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837943.920698:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240308096 00000100:00100000:0.0:1788837943.920712:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240308096 00000100:00100000:0.0:1788837943.920790:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:0.0:1788837943.920803:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+24:10453:x1875732240308096:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:0.0:1788837943.921419:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+25:10453:x1875732240308096:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 615us (1004us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1788837943.921428:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:3.0:1788837943.925399:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837943.925516:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240308224 00000100:00100000:2.0:1788837943.925531:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240308224 00000100:00100000:2.0:1788837943.925616:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:2.0:1788837943.925629:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+25:10453:x1875732240308224:12345-192.168.204.54@tcp:103:lfs.0 00010000:00010000:2.0:1788837943.925651:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788837943.925709:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e67b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d071 expref: 25 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.925736:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6811 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d086 expref: 24 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.925751:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e66ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d032 expref: 23 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.925764:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a45487f600) 00010000:00010000:2.0:1788837943.926110:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837943.926195:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+22:10453:x1875732240308224:12345-192.168.204.54@tcp:103:lfs.0 Request processed in 566us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837943.926252:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:3.0:1788837943.932917:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837943.933267:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240308352 00000100:00100000:2.0:1788837943.933282:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240308352 00000100:00100000:2.0:1788837943.933363:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:2.0:1788837943.933376:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+22:10453:x1875732240308352:12345-192.168.204.54@tcp:58:lfs.0 00010000:00010000:2.0:1788837943.933574:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e682d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.933599:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e682d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.933612:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e682d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788837943.934530:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788837943.934759:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788837943.934861:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788837943.935013:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+22:10453:x1875732240308352:12345-192.168.204.54@tcp:58:lfs.0 Request processed in 1634us (2107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837943.935024:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:3.0:1788837943.958793:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837943.958974:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240308480 00000100:00100000:2.0:1788837943.958990:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240308480 00000100:00100000:2.0:1788837943.959069:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:2.0:1788837943.959082:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+22:10455:x1875732240308480:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788837943.959111:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837943.959139:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e6834 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d094 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.959257:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e683b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.959275:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e683b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.959289:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e683b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.959448:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6842 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.959458:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.959465:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.959785:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6849 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.959804:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6849 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.959812:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6849 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837943.959875:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788837943.959881:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837943.959908:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6849 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.959923:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6849 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.959932:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e683b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.959939:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e683b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.959947:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e683b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.960019:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837943.960026:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e683b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.960035:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e683b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.960052:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:2.0:1788837943.960055:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837943.960070:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e683b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.960077:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e683b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.960092:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.960098:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6842 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.960105:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6842 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.960110:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4c00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837943.960113:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6842 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.960120:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6842 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.960128:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a448b3cd00) 00010000:00010000:2.0:1788837943.960131:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837943.960134:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6842 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.960140:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6842 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.960179:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e6834 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d094 expref: 24 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.960273:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6849 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d094 expref: 23 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837943.960282:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a448b3ce00) 00010000:00010000:2.0:1788837943.960284:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788837943.960287:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5800, rc 0) 00000100:00100000:2.0:1788837943.962511:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+23:10455:x1875732240308480:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 3044us (3348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837943.962528:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 67 00010000:00010000:0.0:1788837944.867607:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788837944.932049:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788837944.932061:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788837944.932121:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788837944.932133:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788837944.932338:0:11659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875732255015040:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788837944.932472:0:11659:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b66e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837944.940981:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837944.941257:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240308608 00000100:00100000:1.0:1788837944.941270:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240308608 00000100:00100000:1.0:1788837944.941348:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:1.0:1788837944.941368:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+24:10466:x1875732240308608:12345-192.168.204.54@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788837944.941480:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+24:10466:x1875732240308608:12345-192.168.204.54@tcp:900:lhsmtool_posix.0 Request processed in 114us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837944.941490:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:0.0:1788837944.941856:0:11659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875732255015040:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788837944.946457:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837944.946585:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240308736 00000100:00100000:1.0:1788837944.946599:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240308736 00000100:00100000:1.0:1788837944.946676:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:1.0:1788837944.946688:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+23:10466:x1875732240308736:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788837944.946732:0:10730:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788837944.946909:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+23:10466:x1875732240308736:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 223us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837944.946917:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:1.0:1788837944.953149:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837944.953309:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240308864 00000100:00100000:2.0:1788837944.953323:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240308864 00000100:00100000:2.0:1788837944.953391:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:2.0:1788837944.953402:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+23:10466:x1875732240308864:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788837944.953502:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6850 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.953524:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6850 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.953541:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6850 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.953560:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6857 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.953567:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6857 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.953584:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6857 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.953620:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e685e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.953630:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e685e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.953636:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e685e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837944.953688:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788837944.953693:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837944.953709:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e685e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.953723:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6850 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.953729:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6850 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.953736:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6850 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.953743:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837944.953748:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6850 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.953755:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6850 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.953778:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a448b3cf00) 00010000:00010000:2.0:1788837944.953781:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837944.953787:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6850 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.953793:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6850 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.953805:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6857 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.953811:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6857 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.953817:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6857 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.953823:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5c00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837944.953839:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6857 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.953845:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6857 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.953853:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff97a448b3cb00) 00010000:00010000:2.0:1788837944.953856:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837944.953859:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6857 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.953864:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6857 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.953891:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e685e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.953898:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e685e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.953904:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e685e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.953910:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4e00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837944.953913:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e685e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.953919:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e685e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.953929:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a448b3ce00) 00010000:00010000:2.0:1788837944.953931:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837944.953934:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e685e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.953940:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e685e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837944.954039:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+23:10466:x1875732240308864:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 Request processed in 637us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837944.954048:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:1.0:1788837944.957181:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837944.957438:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240309120 00000100:00100000:0.0:1788837944.957452:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240309120 00000100:00100000:0.0:1788837944.957526:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:0.0:1788837944.957540:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+23:10466:x1875732240309120:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788837944.957567:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837944.957596:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6865 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d09b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837944.957730:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e686c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837944.957748:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e686c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837944.957763:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e686c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837944.957776:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788837944.957913:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e686c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837944.957921:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e686c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837944.957929:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e686c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837944.957948:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e790800 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837944.957953:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e686c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837944.957963:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e686c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837944.957978:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a448b3ce00) 00010000:00010000:0.0:1788837944.957981:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788837944.957987:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e686c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837944.957993:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e686c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837944.958063:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6865 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d09b expref: 25 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837944.958074:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a448b3cf00) 00010000:00010000:0.0:1788837944.958077:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788837944.958081:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6865 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d09b expref: 25 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837944.958092:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e791c00, rc 0) 00000100:00100000:0.0:1788837944.958321:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+24:10466:x1875732240309120:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 783us (1164us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1788837944.958330:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:3.0:1788837944.965758:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837944.965870:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240309248 00000100:00100000:1.0:1788837944.965885:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240309248 00000100:00100000:1.0:1788837944.965963:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:1.0:1788837944.965976:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+24:10466:x1875732240309248:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788837944.966041:0:7972:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788837944.966196:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+24:10466:x1875732240309248:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 222us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837944.966231:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:1.0:1788837944.977666:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837944.977776:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240309504 00000100:00100000:0.0:1788837944.977798:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240309504 00000100:00100000:0.0:1788837944.977921:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:0.0:1788837944.977933:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+24:10466:x1875732240309504:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788837944.977961:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837944.977965:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788837944.978000:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e6826 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d08d expref: 24 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837944.978030:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:0.0:1788837944.978036:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837944.978052:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e687a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d0a2 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788837944.979502:0:5808:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788837944.980136:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6881 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837944.980157:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837944.980172:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837944.980540:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e687a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0a2 expref: 26 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837944.980562:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6881 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0a2 expref: 25 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837944.980729:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97a462b58100) 00010000:00010000:0.0:1788837944.980732:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837944.980737:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e790800, rc 0) 00000100:00100000:0.0:1788837944.980845:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+25:10466:x1875732240309504:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 2913us (3248us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1788837944.980855:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:1.0:1788837944.988912:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837944.989476:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240309760 00000100:00100000:2.0:1788837944.989491:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240309760 00000100:00100000:2.0:1788837944.990097:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:2.0:1788837944.990119:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+25:10466:x1875732240309760:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788837944.990247:0:10730:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837944.990289:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6881 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0a2 expref: 25 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.990315:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97a462b58100) 00010000:00010000:2.0:1788837944.990329:0:10730:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837944.990360:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e688f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.990378:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e688f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.990390:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e688f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.990407:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6896 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x9aa7ca5b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.990414:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6896 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9aa7ca5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.990421:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6896 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9aa7ca5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.990689:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e688f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.990698:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e688f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.990714:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e688f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.990720:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4e00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837944.990725:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e688f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.990734:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e688f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.990743:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:2.0:1788837944.990746:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837944.990750:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e688f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.990757:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e688f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.990766:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6896 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9aa7ca5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.990772:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6896 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9aa7ca5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.990778:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6896 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9aa7ca5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.990783:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5c00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837944.990787:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6896 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9aa7ca5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.990802:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6896 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9aa7ca5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.990811:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x9aa7ca5b (ffff97a448b3cb00) 00010000:00010000:2.0:1788837944.990813:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837944.990816:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6896 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9aa7ca5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837944.990821:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6896 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9aa7ca5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837944.990950:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+24:10466:x1875732240309760:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 834us (2050us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788837944.990960:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:0.0:1788837944.995978:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837944.996091:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240309888 00000100:00100000:1.0:1788837944.996113:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240309888 00000100:00100000:1.0:1788837944.996191:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 74 00000100:00100000:1.0:1788837944.996238:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+24:10466:x1875732240309888:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788837944.996264:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837944.996294:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e689d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d0a9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837944.996340:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e68a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837944.996356:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e68a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837944.996369:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e68a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837944.996491:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e689d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0a9 expref: 26 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837944.996510:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e68a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0a9 expref: 25 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837944.996519:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97a45487fb00) 00010000:00010000:1.0:1788837944.996523:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788837944.996526:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3c000, rc 0) 00000100:00100000:1.0:1788837944.998578:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+25:10466:x1875732240309888:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 399us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837944.998675:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 74 00000100:00100000:2.0:1788837945.005516:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837945.005678:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240310144 00000100:00100000:0.0:1788837945.005691:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240310144 00000100:00100000:0.0:1788837945.005780:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 75 00000100:00100000:0.0:1788837945.005793:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46019f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+25:10466:x1875732240310144:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788837945.005924:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e68ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837945.005948:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e68ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837945.005964:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e68ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788837945.006464:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788837945.006945:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1788837945.006959:0:5808:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 325100755864ns, next at 326100752439ns, rc = 0 00000004:00010000:0.0:1788837945.007095:0:5808:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000035218356 reply state 00000000d1d498a4 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e68ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837945.007109:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788837945.007301:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46019f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+27:10466:x1875732240310144:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 1507us (1794us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1788837945.007315:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 75 00000100:00100000:1.0:1788837945.013944:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837945.019340:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240310272 00000100:00100000:0.0:1788837945.019359:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240310272 00000100:00100000:0.0:1788837945.019448:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 76 00000100:00100000:0.0:1788837945.019461:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+27:10466:x1875732240310272:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788837945.019498:0:10730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837945.019532:0:10730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e68b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d0b0 expref: -99 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837945.019626:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e68b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0b0 expref: 28 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837945.019644:0:10730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e68b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0b0 expref: 28 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837945.019672:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97a45487fb00) 00010000:00010000:0.0:1788837945.019676:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788837945.019681:0:10730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e791000, rc 0) 00000100:00100000:0.0:1788837945.019772:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+28:10466:x1875732240310272:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 314us (5842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837945.019780:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 76 00010000:00010000:3.0:1788837945.027600:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e68ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.027625:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e68ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.027635:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e68ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.027643:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e791c00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837945.027650:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e68ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.027660:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e68ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.027701:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97a45487fb00) 00010000:00010000:3.0:1788837945.027705:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788837945.027712:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e68ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.027719:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e68ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837945.027971:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837945.028076:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240310400 00000100:00100000:3.0:1788837945.028089:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240310400 00000100:00100000:3.0:1788837945.028138:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:3.0:1788837945.028148:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1875732240310400:12345-192.168.204.54@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788837945.028286:0:6652:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7@192.168.204.54@tcp t0 exp 0000000000000000 cur 325 last 0 00000020:00000080:3.0:1788837945.028328:0:6652:0:(genops.c:1385:class_connect()) connect: client f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7, cookie 0x2deb895b363e68b9 00002000:00100000:3.0:1788837945.028345:0:6652:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7/ffff97a46e759000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113975 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788837945.028379:0:6652:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788837945.028696:0:6652:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788837945.028735:0:6652:0:(import.c:65:import_set_state_nolock()) ffff97a46e75c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837945.028837:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2348:x1875732240310400:12345-192.168.204.54@tcp:8:lhsmtool_posix.0 Request processed in 676us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837945.028846:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:3.0:1788837945.031985:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837945.032565:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240310528 00000100:00100000:3.0:1788837945.032580:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240310528 00000100:00100000:3.0:1788837945.032712:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:3.0:1788837945.032733:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:0:x1875732240310528:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788837945.033410:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788837945.048443:0:11975:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788837945.048454:0:11975:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788837945.048491:0:11975:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788837945.048500:0:11975:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788837945.145165:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:0:x1875732240310528:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 112408us (113166us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788837945.145182:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 26 00000001:00080000:3.0:1788837945.145264:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:3.0:1788837945.145275:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7 00000100:00100000:2.0:1788837945.147493:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837945.147590:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240310784 00000100:00100000:1.0:1788837945.147604:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240310784 00000100:00100000:1.0:1788837945.147681:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:1.0:1788837945.147693:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46019d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+27:10466:x1875732240310784:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788837945.148037:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46019d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+28:10466:x1875732240310784:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 345us (557us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788837945.148045:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:2.0:1788837945.151752:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837945.151869:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240311040 00000100:00100000:1.0:1788837945.151882:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240311040 00000100:00100000:1.0:1788837945.151958:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:1.0:1788837945.151970:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46019fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+28:10466:x1875732240311040:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788837945.152133:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46019fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+28:10466:x1875732240311040:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 164us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837945.152142:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:2.0:1788837945.154895:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837945.154984:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240311168 00000100:00100000:1.0:1788837945.154998:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240311168 00000100:00100000:1.0:1788837945.155081:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:1.0:1788837945.155094:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46019dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+28:10466:x1875732240311168:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788837945.155123:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837945.155153:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e68c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d0b7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.155288:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e68c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.155307:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e68c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.155342:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e68c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837945.155398:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788837945.155423:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e68c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.155457:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e68c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0b7 expref: 30 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.155479:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e68c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0b7 expref: 29 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.155490:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97a45487fb00) 00010000:00010000:1.0:1788837945.155493:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788837945.155498:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3c600, rc 0) 00000100:00100000:1.0:1788837945.155581:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46019dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+29:10466:x1875732240311168:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 490us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837945.155589:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:3.0:1788837945.159646:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837945.166889:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240311296 00000100:00100000:1.0:1788837945.166913:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240311296 00000100:00100000:1.0:1788837945.167012:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:1.0:1788837945.167026:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2352:x1875732240311296:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788837945.167053:0:6652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837945.167081:0:6652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c033c147/0x2deb895b363e68ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d0be expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788837945.167132:0:6652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f8038, blocks: 0x1 00010000:00010000:1.0:1788837945.167174:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=325s v=(0 0) 00010000:00010000:1.0:1788837945.167179:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837945.167191:0:6652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c033c147/0x2deb895b363e68ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0be expref: 6 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.167234:0:6652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c033c147/0x2deb895b363e68ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0be expref: 6 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.167250:0:6652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3de00, rc 0) 00000100:00100000:1.0:1788837945.167343:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2352:x1875732240311296:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 320us (7713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837945.167352:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:2.0:1788837945.174988:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837945.176633:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240311552 00000100:00100000:1.0:1788837945.176651:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240311552 00000100:00100000:1.0:1788837945.176764:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 79 00000100:00100000:1.0:1788837945.176776:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46019c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+29:10466:x1875732240311552:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788837945.176942:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46019c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+29:10466:x1875732240311552:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 167us (1966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837945.176950:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 79 00000100:00100000:3.0:1788837945.181487:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837945.181758:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240311680 00000100:00100000:0.0:1788837945.181779:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240311680 00000100:00100000:0.0:1788837945.181869:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:0.0:1788837945.181881:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:10466:x1875732240311680:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788837945.181904:0:6653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837945.181933:0:6653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7dc510a/0x2deb895b363e68d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d0c5 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837945.181972:0:6653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c033c147/0x2deb895b363e68ce lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0be expref: 7 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837945.181983:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837945.181988:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837945.181994:0:6653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7dc510a/0x2deb895b363e68d5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0c5 expref: 7 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837945.182115:0:6653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c033c147/0x2deb895b363e68ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0be expref: 7 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837945.182133:0:6653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c033c147/0x2deb895b363e68ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0be expref: 7 pid: 6652 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837945.182232:0:6653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6653:1875732255015168:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788837945.182358:0:6653:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b66e240 going to sleep for 11 seconds 00000100:00100000:0.0:1788837945.192672:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837945.192716:0:7599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240311808 00000100:00100000:0.0:1788837945.192728:0:7599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240311808 00010000:00010000:0.0:1788837945.192794:0:7599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c033c147/0x2deb895b363e68ce lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0be expref: 8 pid: 6652 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837945.192853:0:7599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:0.0:1788837945.192867:0:7599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4497d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:2352:x1875732240311808:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837945.192886:0:7599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837945.192919:0:7599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c033c147/0x2deb895b363e68ce lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0be expref: 8 pid: 6652 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837945.192936:0:7599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c033c147/0x2deb895b363e68ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0be expref: 8 pid: 6652 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837945.192977:0:7599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837945.192982:0:7599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837945.192995:0:7599:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a7dc510a/0x2deb895b363e68d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0c5 expref: 8 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837945.193006:0:7599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7dc510a/0x2deb895b363e68d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0c5 expref: 8 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837945.193053:0:7599:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a7dc510a/0x2deb895b363e68d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0c5 expref: 8 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837945.193072:0:7599:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7599:1875732255015296:192.168.204.54@tcp:105: 00000100:00100000:0.0:1788837945.193193:0:7599:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b66ed80 going to sleep for 11 seconds 00010000:00010000:3.0:1788837945.193708:0:6653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c033c147/0x2deb895b363e68ce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0be expref: 8 pid: 6652 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837945.193731:0:6653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6653:1875732255015168:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788837945.193762:0:6653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a7dc510a/0x2deb895b363e68d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0c5 expref: 7 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.193775:0:6653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e791a00, rc 0) 00000100:00100000:3.0:1788837945.193846:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:10466:x1875732240311680:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 11966us (12374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837945.193856:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:0.0:1788837945.197364:0:7599:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7599:1875732255015296:192.168.204.54@tcp:105: 00010000:00010000:0.0:1788837945.197421:0:7599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837945.197505:0:7599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4497d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2352:x1875732240311808:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 4639us (4846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837945.197518:0:7599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:3.0:1788837945.200502:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837945.200628:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240311936 00000100:00100000:0.0:1788837945.200644:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240311936 00002000:00100000:0.0:1788837945.200720:0:6658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff97a46e7a8a80 x1875732240311936/t0(0) o4->f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7@192.168.204.54@tcp:601/0 lens 504/0 e 0 to 0 dl 1788837956 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788837945.200732:0:6658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a46e7a8a80 with x1875732240311936 ext(0->8) 00002000:00010000:0.0:1788837945.200739:0:6658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97a46e7a8a80 00000100:00100000:0.0:1788837945.200779:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:0.0:1788837945.200790:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2352:x1875732240311936:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788837945.202444:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:2352:x1875732240311936:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 Request processed in 1647us (1947us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788837945.202457:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00002000:00100000:0.0:1788837945.202469:0:6658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff97a46e7a8a80 x1875732240311936/t4294967302(0) o4->f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7@192.168.204.54@tcp:601/0 lens 504/448 e 0 to 0 dl 1788837956 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788837945.202485:0:6658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a46e7a8a80 with x1875732240311936 ext(0->8) 00002000:00010000:0.0:1788837945.202492:0:6658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97a46e7a8a80 00000100:00100000:0.0:1788837945.212104:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837945.212381:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240312064 00000100:00100000:1.0:1788837945.212392:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240312064 00000100:00100000:1.0:1788837945.212464:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:1.0:1788837945.212480:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+29:10466:x1875732240312064:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788837945.258938:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:3.0:1788837945.258960:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:3.0:1788837945.258999:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:3.0:1788837945.259019:0:5830:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:2.0:1788837945.259462:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837945.259491:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46019ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255015424:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788837945.259585:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837945.259671:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255015424 00000100:00100000:2.0:1788837945.259681:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255015424 00000100:00100000:2.0:1788837945.259753:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788837945.259763:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46019d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255015424:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788837945.259992:0:6652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788837945.259997:0:6652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788837944 00002000:00010000:2.0:1788837945.259999:0:6652:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788837945.260013:0:6652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788837944 -> 1788837944 00002000:00010000:2.0:1788837945.260015:0:6652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788837945.260063:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46019d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3271:x1875732255015424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 300us (476us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788837945.260071:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1788837945.260097:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788837945.260628:0:3271:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97a46019ea00/2, rc 0, transno 4294967303 00000100:00100000:2.0:1788837945.260638:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46019ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255015424:0@lo:2:osp-syn-0-0.0 00000020:00080000:0.0:1788837945.260779:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1788837945.260803:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788837945.260865:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+13:10466:x1875732240312064:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 Request processed in 48387us (48776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837945.260877:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:0.0:1788837945.263773:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837945.264078:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240312192 00000100:00100000:3.0:1788837945.264104:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240312192 00000100:00100000:3.0:1788837945.264188:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:3.0:1788837945.264226:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:2351:x1875732240312192:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788837945.314354:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:0.0:1788837945.314380:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1788837945.314631:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2351:x1875732240312192:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 Request processed in 50423us (50864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837945.314645:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:0.0:1788837945.316906:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837945.317012:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240312448 00000100:00100000:3.0:1788837945.317026:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240312448 00000100:00100000:3.0:1788837945.317101:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00100000:3.0:1788837945.317114:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+13:10466:x1875732240312448:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788837945.317238:0:10730:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837945.317276:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e68c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0b7 expref: 13 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.317295:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97a45487fb00) 00010000:00010000:3.0:1788837945.317301:0:10730:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788837945.317339:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e68dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.317356:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e68dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.317367:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e68dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788837945.317866:0:10730:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba7bd4cb reply state 0000000007022aa4 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e68dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837945.317879:0:10730:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788837945.318041:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+14:10466:x1875732240312448:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 929us (1147us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788837945.318050:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00100000:1.0:1788837945.331966:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:1.0:1788837945.332063:0:3257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e68dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.332080:0:3257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e68dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.332089:0:3257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e68dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.332095:0:3257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48a200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837945.332102:0:3257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e68dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.332110:0:3257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e68dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.332133:0:3257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97a45487fb00) 00010000:00010000:1.0:1788837945.332137:0:3257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837945.332143:0:3257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e68dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.332324:0:3257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e68dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837945.334791:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240312576 00000100:00100000:0.0:1788837945.334814:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240312576 00000100:00100000:0.0:1788837945.334902:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:0.0:1788837945.334915:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2351:x1875732240312576:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788837945.335282:0:6652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788837945.335287:0:6652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788837944 -> 1788837942 00002000:00010000:0.0:1788837945.335290:0:6652:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788837941 00002000:00010000:0.0:1788837945.335292:0:6652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788837944 -> 1788837942 00002000:00010000:0.0:1788837945.335294:0:6652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788837945.335381:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2351:x1875732240312576:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 468us (3428us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788837945.335390:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:1.0:1788837945.341921:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837945.341966:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240312832 00000100:00100000:1.0:1788837945.341985:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240312832 00000100:00100000:1.0:1788837945.342058:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 82 00000100:00100000:1.0:1788837945.342069:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+13:10466:x1875732240312832:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788837945.342179:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e68e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.342232:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e68a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0a9 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.342244:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e68e3 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.342293:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e68a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0a9 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.342310:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e68a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0a9 expref: 13 pid: 5810 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837945.342328:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448b75f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5809:1875732255015552:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788837945.342445:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a446fbe0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837945.345567:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837945.347900:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448b75f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5809:1875732255015552:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788837945.347945:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e68e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837945.349802:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240312960 00000100:00100000:2.0:1788837945.349832:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240312960 00010000:00010000:2.0:1788837945.349888:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e68a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0a9 expref: 14 pid: 5810 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837945.349937:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:2.0:1788837945.349949:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+14:2352:x1875732240312960:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837945.349968:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837945.349977:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e68a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0a9 expref: 14 pid: 5810 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.349993:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e68a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0a9 expref: 14 pid: 5810 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.350022:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e68a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0a9 expref: 14 pid: 5810 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.350051:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97a45487fb00) 00010000:00010000:2.0:1788837945.350058:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e68e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.350068:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e68e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.350077:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e68e3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.350107:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837945.350352:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+13:2352:x1875732240312960:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 404us (4798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837945.350361:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 43 00010000:00010000:2.0:1788837945.350416:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e68e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.350424:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e68e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.350530:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e68e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.350540:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e68e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.350547:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e68e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.350554:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3c400 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837945.350566:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e68e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.350575:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e68e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.350584:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97a45487fb00) 00010000:00010000:2.0:1788837945.350587:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788837945.350590:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e68e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.350597:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e68e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837945.350641:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+12:10466:x1875732240312832:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 Request processed in 8575us (8735us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788837945.350650:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 82 00000100:00100000:1.0:1788837945.357262:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837945.357404:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240313088 00000100:00100000:3.0:1788837945.357417:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240313088 00000100:00100000:3.0:1788837945.357477:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:3.0:1788837945.357487:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2351:x1875732240313088:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788837945.357543:0:6653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e68ea lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.357568:0:6653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a7dc510a/0x2deb895b363e68d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0c5 expref: 7 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.357578:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837945.357585:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788837945.357589:0:6653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e68ea lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.357633:0:6653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a7dc510a/0x2deb895b363e68d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0c5 expref: 7 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.357651:0:6653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a7dc510a/0x2deb895b363e68d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0c5 expref: 7 pid: 6653 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837945.357669:0:6653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6653:1875732255015680:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788837945.357771:0:6653:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4496f8600 going to sleep for 11 seconds 00000100:00100000:0.0:1788837945.361814:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837945.361941:0:6653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6653:1875732255015680:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788837945.361995:0:6653:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e68ea lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837945.362122:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240313216 00000100:00100000:1.0:1788837945.362131:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240313216 00010000:00010000:1.0:1788837945.362506:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a7dc510a/0x2deb895b363e68d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0c5 expref: 8 pid: 6653 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837945.362560:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:1.0:1788837945.362576:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:2351:x1875732240313216:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837945.362596:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837945.362628:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a7dc510a/0x2deb895b363e68d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0c5 expref: 8 pid: 6653 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.362643:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a7dc510a/0x2deb895b363e68d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0c5 expref: 8 pid: 6653 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.362673:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7dc510a/0x2deb895b363e68d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0c5 expref: 8 pid: 6653 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.362692:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837945.362697:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837945.362704:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e68ea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.362715:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e68ea lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.362751:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837945.362840:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2351:x1875732240313216:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 269us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837945.362849:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 44 00010000:00010000:0.0:1788837945.363003:0:6653:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e68ea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837945.363014:0:6653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e68ea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837945.363047:0:6653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e68ea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837945.363057:0:6653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e68ea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837945.363065:0:6653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e68ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837945.363081:0:6653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48ac00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:0.0:1788837945.363086:0:6653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e68ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837945.363096:0:6653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e68ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837945.363117:0:6653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e68ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837945.363125:0:6653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e68ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837945.363561:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2351:x1875732240313088:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 Request processed in 6073us (6309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837945.363571:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:0.0:1788837945.365139:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837945.365477:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240313472 00000100:00100000:1.0:1788837945.365490:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240313472 00000100:00100000:1.0:1788837945.365566:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 83 00000100:00100000:1.0:1788837945.365578:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+12:10466:x1875732240313472:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788837945.365691:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d800/0x2deb895b363e68f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.365714:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d800/0x2deb895b363e68f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.365729:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d800/0x2deb895b363e68f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.366042:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e68f8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.366057:0:7972:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e68b2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0b0 expref: 13 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.366066:0:7972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e68f8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.366111:0:7972:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e68b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0b0 expref: 13 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.366128:0:7972:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e68b2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0b0 expref: 13 pid: 10730 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837945.366145:0:7972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448b75880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7972:1875732255015808:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788837945.366364:0:7972:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b66e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837945.369306:0:7972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448b75880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7972:1875732255015808:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788837945.369345:0:7972:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e68f8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837945.371354:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837945.371555:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240313600 00000100:00100000:2.0:1788837945.371569:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240313600 00010000:00010000:2.0:1788837945.371621:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e68b2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0b0 expref: 14 pid: 10730 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837945.371664:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:2.0:1788837945.371675:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+14:2351:x1875732240313600:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837945.371694:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837945.371703:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e68b2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0b0 expref: 14 pid: 10730 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.371719:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e68b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0b0 expref: 14 pid: 10730 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.371770:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e68b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0b0 expref: 14 pid: 10730 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.371792:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97a45487fb00) 00010000:00010000:2.0:1788837945.371800:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e68f8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.371812:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e68f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.371835:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e68f8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.371868:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837945.371952:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+13:2351:x1875732240313600:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 279us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837945.371962:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 45 00010000:00010000:3.0:1788837945.372249:0:7972:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e68f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.372260:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e68f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788837945.372531:0:7972:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1788837945.372715:0:7972:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1788837945.372765:0:7972:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1788837945.372885:0:7972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7972:1875732255015936:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788837945.372964:0:7972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837945.373250:0:7972:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4496f8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788837945.373597:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255015936 00000100:00100000:2.0:1788837945.373606:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255015936 00000100:00100000:2.0:1788837945.373659:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788837945.373669:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7972:x1875732255015936:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788837945.373776:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7972:x1875732255015936:12345-0@lo:1000:mdt00_003.0 Request processed in 107us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837945.373784:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788837945.373966:0:7972:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1788837945.373973:0:7972:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97a46019ea00, transno 4294967303 00000100:00100000:3.0:1788837945.373994:0:7972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7972:1875732255015936:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788837945.374618:0:7972:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1788837945.374723:0:7972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7972:1875732255016064:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788837945.374781:0:7972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837945.374830:0:7972:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4496f8600 going to sleep for 11 seconds 00000100:00100000:0.0:1788837945.375157:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255016064 00000100:00100000:0.0:1788837945.375165:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255016064 00000100:00100000:0.0:1788837945.375245:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788837945.375255:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7972:x1875732255016064:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788837945.375505:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7972:x1875732255016064:12345-0@lo:1000:mdt00_003.0 Request processed in 250us (722us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788837945.375513:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788837945.377123:0:7972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7972:1875732255016064:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788837945.377233:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e68f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.377247:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e68f8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.377279:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e68f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.377287:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3d200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837945.377292:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e68f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.377301:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e68f8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.377323:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97a45487fb00) 00010000:00010000:3.0:1788837945.377327:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788837945.377333:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e68f8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.377340:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e68f8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.377396:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e682d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.377404:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e682d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.377410:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e682d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.377416:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4000 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837945.377419:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e682d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.377438:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e682d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.377449:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a448b3ce00) 00010000:00010000:3.0:1788837945.377452:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788837945.377455:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e682d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.377461:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e682d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.377489:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e68ff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.377506:0:7972:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6849 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d094 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.377515:0:7972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e68ff lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.377562:0:7972:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6849 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d094 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.377582:0:7972:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6849 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d094 expref: 16 pid: 5809 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837945.377599:0:7972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7972:1875732255016192:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788837945.377725:0:7972:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4496f8600 going to sleep for 11 seconds 00000100:00100000:0.0:1788837945.381553:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837945.381681:0:7599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240313728 00000100:00100000:2.0:1788837945.381694:0:7599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240313728 00010000:00010000:2.0:1788837945.381748:0:7599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6849 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d094 expref: 17 pid: 5809 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837945.381832:0:7599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:2.0:1788837945.381845:0:7599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+17:2351:x1875732240313728:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837945.381867:0:7599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837945.381874:0:7599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6849 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d094 expref: 17 pid: 5809 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.381889:0:7599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6849 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d094 expref: 17 pid: 5809 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.381919:0:7599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a448b3ce00) 00010000:00010000:2.0:1788837945.381925:0:7599:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e68ff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.381937:0:7599:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e68ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.381946:0:7599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e68ff lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.381970:0:7599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837945.382042:0:7599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+17:2351:x1875732240313728:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 199us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837945.382050:0:7599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 46 00010000:00010000:3.0:1788837945.382618:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6849 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d094 expref: 16 pid: 5809 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837945.382650:0:7972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7972:1875732255016192:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788837945.382678:0:7972:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e68ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.382689:0:7972:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e68ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.382696:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e68ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.382710:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e68ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.382717:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e68ff lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.382724:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e68ff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.382730:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48be00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837945.382734:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e68ff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.382742:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e68ff lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.382754:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a448b3ce00) 00010000:00010000:3.0:1788837945.382757:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837945.382762:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e68ff lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.382779:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e68ff lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.382790:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d800/0x2deb895b363e68f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.382796:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d800/0x2deb895b363e68f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.382802:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d800/0x2deb895b363e68f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.382807:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3d800 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837945.382809:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d800/0x2deb895b363e68f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.382815:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d800/0x2deb895b363e68f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.382836:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a448b3ce00) 00010000:00010000:3.0:1788837945.382838:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788837945.382841:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d800/0x2deb895b363e68f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.382847:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d800/0x2deb895b363e68f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788837945.383350:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788837945.383357:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788837945.383402:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788837945.383410:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788837945.383592:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+15:10466:x1875732240313472:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 18013us (18460us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1788837945.383604:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 83 00000020:00080000:3.0:1788837945.383617:0:7972:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788837945.390492:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837945.390614:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240313984 00000100:00100000:1.0:1788837945.390627:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240313984 00000100:00100000:1.0:1788837945.390701:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:1.0:1788837945.390713:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+15:10466:x1875732240313984:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788837945.392944:0:5811:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788837945.393385:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1788837945.393481:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6906 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.393522:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6906 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.393537:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6906 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.393548:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6906 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.393555:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6906 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.393562:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6906 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.393634:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788837945.393797:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+17:10466:x1875732240313984:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 3078us (3314us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1788837945.393809:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000020:00080000:2.0:1788837945.393829:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788837945.395888:0:7597:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837945.395904:0:7597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6906 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.395916:0:7597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4a00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:3.0:1788837945.395920:0:7597:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6906 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.395932:0:7597:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6906 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.395955:0:7597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97a448b3cd00) 00010000:00010000:3.0:1788837945.395958:0:7597:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788837945.395964:0:7597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6906 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.395970:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6906 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837945.395993:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837945.395995:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837945.396007:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837945.890685:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837946.020766:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837946.020800:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46019ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255016320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837946.020912:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837946.021112:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255016320 00000100:00100000:2.0:1788837946.021124:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255016320 00000100:00100000:2.0:1788837946.021196:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788837946.021231:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3274:x1875732255016320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837946.021261:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1788837946.021313:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3274:x1875732255016320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837946.021320:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788837946.021539:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46019ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255016320:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788837946.411263:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788837946.411275:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788837946.411322:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788837946.411329:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788837946.915402:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788837947.305399:0:12027:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788837947.305414:0:12027:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788837947.305467:0:12027:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788837947.305476:0:12027:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788837947.442679:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837947.442890:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240314240 00000100:00100000:3.0:1788837947.442907:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240314240 00000100:00100000:3.0:1788837947.443016:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 84 00000100:00100000:3.0:1788837947.443029:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+17:10485:x1875732240314240:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788837947.443079:0:10730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837947.443109:0:10730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e690d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d0cc expref: -99 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.443279:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e6914 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.443299:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e6914 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.443312:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e6914 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837947.443326:0:10730:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788837947.443496:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e690d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0cc expref: 20 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.443518:0:10730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e6914 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0cc expref: 19 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.443529:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:3.0:1788837947.443533:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788837947.443539:0:10730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48be00, rc 0) 00000100:00100000:3.0:1788837947.443617:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+19:10485:x1875732240314240:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 591us (961us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1788837947.443626:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 84 00000100:00080000:0.0:1788837947.443979:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837947.454372:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837947.457393:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240314368 00000100:00100000:1.0:1788837947.457748:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240314368 00000100:00100000:1.0:1788837947.458319:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 85 00000100:00100000:1.0:1788837947.458334:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+19:10485:x1875732240314368:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:1.0:1788837947.458453:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6922 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.458477:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6922 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.458491:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6922 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.458519:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6929 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.458528:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6929 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.458546:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6929 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.459726:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6930 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.459743:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6930 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.459755:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6930 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788837947.460082:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6930 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.460101:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6922 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.460109:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6922 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.460118:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6922 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.460125:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3d000 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837947.460130:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6922 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.460148:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6922 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.460163:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:1.0:1788837947.460167:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837947.460173:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6922 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.460180:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6922 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.460195:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6929 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.462979:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6929 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.462998:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6929 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.463006:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3dc00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837947.463012:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6929 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.463024:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6929 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.463047:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a45487f300) 00010000:00010000:1.0:1788837947.463052:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837947.463058:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6929 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.463082:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6929 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.463115:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6930 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.463122:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6930 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.463129:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6930 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.463134:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3ca00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837947.463137:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6930 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.463144:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6930 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.463153:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a45487fa00) 00010000:00010000:1.0:1788837947.463155:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837947.463159:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6930 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.463165:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6930 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837947.463327:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+19:10485:x1875732240314368:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 4989us (8963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837947.463339:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 85 00000100:00100000:0.0:1788837947.510594:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837947.510679:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240314624 00000100:00100000:2.0:1788837947.510690:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240314624 00000100:00100000:2.0:1788837947.510752:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:2.0:1788837947.510763:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+19:10488:x1875732240314624:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788837947.510800:0:7972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837947.510823:0:7972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6937 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d0d3 expref: -99 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.510909:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e693e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.510926:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e693e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.510941:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e693e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.510956:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6945 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.510964:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.510971:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.511274:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e694c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.511283:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e694c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.511302:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e694c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837947.511311:0:7972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788837947.511405:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e693e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.511413:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e693e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.511418:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e693e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.511425:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4600 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837947.511429:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e693e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.511437:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e693e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.511448:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:2.0:1788837947.511451:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837947.511456:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e693e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.511462:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e693e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.511473:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.511479:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6945 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.511489:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6945 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.511494:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5a00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837947.511497:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6945 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.511503:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6945 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.511511:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a448b3c400) 00010000:00010000:2.0:1788837947.511513:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837947.511516:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6945 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.511522:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6945 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.511561:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6937 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0d3 expref: 22 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.511574:0:7972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e694c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0d3 expref: 21 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.511581:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a448b3cb00) 00010000:00010000:2.0:1788837947.511583:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837947.511585:0:7972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5400, rc 0) 00000100:00100000:2.0:1788837947.511646:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+21:10488:x1875732240314624:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 885us (1063us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1788837947.511661:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:3.0:1788837947.516415:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837947.516524:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240314752 00000100:00100000:2.0:1788837947.516535:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240314752 00000100:00100000:2.0:1788837947.516599:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:2.0:1788837947.516609:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+21:10488:x1875732240314752:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:2.0:1788837947.516677:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e695a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.516694:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e695a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.516704:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e695a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.516729:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e695a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.516736:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e695a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.516742:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e695a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.516748:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837947.516752:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e695a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.516758:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e695a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.516769:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a448b3cb00) 00010000:00010000:2.0:1788837947.516798:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788837947.516803:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e695a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.516809:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e695a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837947.516877:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+21:10488:x1875732240314752:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 269us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837947.516884:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:3.0:1788837947.523661:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837947.525136:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240315008 00000100:00100000:1.0:1788837947.525152:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240315008 00000100:00100000:1.0:1788837947.525236:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:1.0:1788837947.525246:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4713af850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+21:10488:x1875732240315008:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1788837947.525488:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4713af850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+22:10488:x1875732240315008:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 243us (1836us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1788837947.525496:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:2.0:1788837947.555497:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837947.555521:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46019f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255016448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837947.555593:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837947.555661:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255016448 00000100:00100000:2.0:1788837947.555669:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255016448 00000100:00100000:2.0:1788837947.555726:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788837947.555735:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46019d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3273:x1875732255016448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788837947.555773:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837947.555832:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46019d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3273:x1875732255016448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837947.555839:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1788837947.555862:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837947.555898:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46019f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255016448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837947.565122:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46019f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732255016576:0@lo:400:kworker.0 00000100:00100000:2.0:1788837947.565236:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837947.565280:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ec3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732255017088:0@lo:400:kworker.0 00000100:00100000:2.0:1788837947.565307:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837947.565348:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837947.565355:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46019ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732255016704:0@lo:400:kworker.0 00000100:00100000:2.0:1788837947.565395:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837947.565434:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255017088 00000100:00100000:2.0:1788837947.565441:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255017088 00000100:00100000:2.0:1788837947.565503:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255016704 00000100:00100000:2.0:1788837947.565506:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255016704 00000100:00100000:2.0:1788837947.565525:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788837947.565533:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1875732255017088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837947.565591:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1875732255017088:12345-0@lo:400:kworker.0 Request processed in 59us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837947.565597:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788837947.565613:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788837947.565619:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732255016704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837947.566419:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732255016704:12345-0@lo:400:kworker.0 Request processed in 796us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837947.566429:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:2.0:1788837947.566461:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837947.566477:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46019ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255016960:0@lo:400:kworker.0 00000100:00100000:2.0:1788837947.566510:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837947.566536:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837947.566542:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46019d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3274:1875732255016832:0@lo:400:kworker.0 00000100:00100000:2.0:1788837947.566562:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837947.566612:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46019ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732255016704:0@lo:400:kworker.0 00000100:00100000:2.0:1788837947.566630:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ec3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732255017088:0@lo:400:kworker.0 00000100:00100000:0.0:1788837947.566741:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255016832 00000100:00100000:0.0:1788837947.566747:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255016832 00000100:00100000:0.0:1788837947.566796:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788837947.566804:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1875732255016832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837947.566847:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1875732255016832:12345-0@lo:400:kworker.0 Request processed in 45us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837947.566854:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788837947.567192:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255016960 00000100:00100000:0.0:1788837947.567197:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255016960 00000100:00100000:0.0:1788837947.567245:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788837947.567252:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3274:x1875732255016960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837947.567284:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3274:x1875732255016960:12345-0@lo:400:kworker.0 Request processed in 33us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837947.567290:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1788837947.567719:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788837947.567735:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837947.567766:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46019d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3274:1875732255016832:0@lo:400:kworker.0 00000100:00100000:2.0:1788837947.567790:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46019ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255016960:0@lo:400:kworker.0 00000100:00100000:1.0:1788837947.570765:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255016576 00000100:00100000:1.0:1788837947.570796:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255016576 00000100:00100000:1.0:1788837947.570856:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788837947.570867:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3271:x1875732255016576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837947.570983:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3271:x1875732255016576:12345-0@lo:400:kworker.0 Request processed in 118us (5747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837947.570989:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788837947.572182:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837947.572406:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240315264 00000100:00100000:2.0:1788837947.572414:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240315264 00000100:00100000:2.0:1788837947.572462:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 88 00000100:00100000:2.0:1788837947.572472:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+22:10009:x1875732240315264:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788837947.572494:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837947.572518:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6961 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d0da expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.572658:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6968 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.572675:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e694c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0d3 expref: 23 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.572684:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6968 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837947.576546:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46019f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732255016576:0@lo:400:kworker.0 00010000:00010000:2.0:1788837947.579510:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e694c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0d3 expref: 23 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.579534:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e694c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0d3 expref: 23 pid: 7972 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837947.579550:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5808:1875732255017216:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788837947.579647:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a44709b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788837947.587684:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837947.589217:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5808:1875732255017216:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788837947.589246:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6968 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837947.589278:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240315392 00000100:00100000:2.0:1788837947.589284:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240315392 00010000:00010000:2.0:1788837947.589318:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e694c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0d3 expref: 24 pid: 7972 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837947.589354:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:2.0:1788837947.589362:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+24:2352:x1875732240315392:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837947.589377:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837947.589384:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e694c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0d3 expref: 24 pid: 7972 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.589395:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e694c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0d3 expref: 24 pid: 7972 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.589417:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e694c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0d3 expref: 24 pid: 7972 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.589432:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a448b3cb00) 00010000:00010000:2.0:1788837947.589437:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6968 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.589445:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6968 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.589466:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6968 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.589488:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837947.589538:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+23:2352:x1875732240315392:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 177us (1862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837947.589545:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 47 00010000:00010000:2.0:1788837947.590131:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6968 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.590139:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6968 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837947.590158:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788837947.590308:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6961 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0da expref: 24 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.590323:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6968 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0da expref: 23 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.590330:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a448b3cb00) 00010000:00010000:2.0:1788837947.590333:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788837947.590335:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5600, rc 0) 00000100:00100000:2.0:1788837947.590370:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+23:10009:x1875732240315264:12345-192.168.204.54@tcp:101:bash.0 Request processed in 17900us (18196us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1788837947.590377:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 88 00000100:00100000:1.0:1788837947.596880:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837947.611536:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240315648 00000100:00100000:1.0:1788837947.611551:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240315648 00000100:00100000:1.0:1788837947.611610:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 89 00000100:00100000:1.0:1788837947.611619:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+23:10009:x1875732240315648:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:1.0:1788837947.611898:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6976 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.611917:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6976 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.611929:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6976 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788837947.611991:0:7972:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1788837947.612032:0:7972:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f55069b0 reply state 000000009e93f672 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6976 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837947.612041:0:7972:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788837947.612091:0:7972:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1788837947.612236:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+27:10009:x1875732240315648:12345-192.168.204.54@tcp:36:bash.0 Request processed in 617us (15363us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1788837947.612243:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 89 00000020:00080000:1.0:1788837947.612248:0:7972:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788837947.624290:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:2.0:1788837947.624321:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6976 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.624345:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6976 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.624353:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6976 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.624359:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3ca00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837947.624365:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6976 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.624373:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6976 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.624391:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a448b3cb00) 00010000:00010000:2.0:1788837947.624395:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837947.624400:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6976 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.624407:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6976 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837947.624438:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240315776 00000100:00100000:2.0:1788837947.624448:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240315776 00000100:00100000:2.0:1788837947.624492:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 90 00000100:00100000:2.0:1788837947.624501:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+26:10009:x1875732240315776:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788837947.624527:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837947.624544:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e697d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d0e1 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.624601:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e697d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0e1 expref: 27 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.624622:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e697d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0e1 expref: 27 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.624643:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a448b3cb00) 00010000:00010000:2.0:1788837947.624647:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788837947.624650:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5200, rc 0) 00000100:00100000:2.0:1788837947.624711:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+27:10009:x1875732240315776:12345-192.168.204.54@tcp:101:bash.0 Request processed in 209us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837947.624719:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 90 00000100:00100000:3.0:1788837947.638639:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837947.638685:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240315904 00000100:00100000:3.0:1788837947.638696:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240315904 00000100:00100000:3.0:1788837947.638793:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:3.0:1788837947.638805:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:10009:x1875732240315904:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1788837947.638831:0:6650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837947.638861:0:6650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf3a0f58/0x2deb895b363e6984 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d0e8 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788837947.638898:0:6650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f8036, atime: 0x6a9f8035, ctime: 0x6a9f8036, blocks: 0xb 00010000:00010000:3.0:1788837947.638927:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=327s v=(0 0) 00010000:00010000:3.0:1788837947.638932:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837947.638943:0:6650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf3a0f58/0x2deb895b363e6984 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0e8 expref: 7 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.638968:0:6650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bf3a0f58/0x2deb895b363e6984 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0e8 expref: 7 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.638983:0:6650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48a000, rc 0) 00000100:00100000:3.0:1788837947.639068:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:10009:x1875732240315904:12345-192.168.204.54@tcp:101:bash.0 Request processed in 265us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837947.639075:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00080000:3.0:1788837947.639106:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837947.642960:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837947.643023:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240316032 00000100:00100000:2.0:1788837947.643033:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240316032 00002000:00010000:2.0:1788837947.643072:0:6656:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1788837947.643077:0:6656:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a46e7e4a80 with x1875732240316032 ext(0->18446744073709551615) 00002000:00010000:2.0:1788837947.643089:0:6656:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97a46e7e4a80. 00000100:00100000:2.0:1788837947.643178:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:2.0:1788837947.643190:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2351:x1875732240316032:12345-192.168.204.54@tcp:10:bash.0 00002000:00010000:2.0:1788837947.643545:0:6656:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788837947.643549:0:6656:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788837942 -> 1788837946 00002000:00010000:2.0:1788837947.643552:0:6656:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788837941 -> 1788837941 00002000:00010000:2.0:1788837947.643554:0:6656:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788837942 -> 1788837946 00002000:00010000:2.0:1788837947.643557:0:6656:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788837947.643628:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:2351:x1875732240316032:12345-192.168.204.54@tcp:10:bash.0 Request processed in 441us (679us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788837947.643636:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00002000:00010000:2.0:1788837947.643647:0:6656:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1788837947.643650:0:6656:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a46e7e4a80 with x1875732240316032 ext(0->18446744073709551615) 00002000:00010000:2.0:1788837947.643655:0:6656:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97a46e7e4a80. 00000001:00080000:3.0:1788837947.664908:0:7611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:3.0:1788837947.775174:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837947.775310:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240316160 00000100:00100000:2.0:1788837947.775320:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240316160 00000100:00100000:2.0:1788837947.775444:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 91 00000100:00100000:2.0:1788837947.775454:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+27:10502:x1875732240316160:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:2.0:1788837947.775530:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e698b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.775550:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e698b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.775561:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e698b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.775604:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6992 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.775611:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6992 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.775617:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6992 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.775884:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6999 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.775893:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.775901:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837947.775962:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.775974:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e698b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.775980:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e698b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.775987:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e698b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.775993:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5800 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837947.776010:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e698b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.776018:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e698b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.776031:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:2.0:1788837947.776034:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837947.776038:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e698b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.776043:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e698b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.776056:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6992 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.776061:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6992 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.776073:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6992 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.776078:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4000 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837947.776081:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6992 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.776087:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6992 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.776094:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a448b3c800) 00010000:00010000:2.0:1788837947.776096:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837947.776099:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6992 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.776104:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6992 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.776117:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.776123:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6999 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.776128:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6999 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.776132:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5c00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837947.776135:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6999 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.776150:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6999 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.776158:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a448b3cb00) 00010000:00010000:2.0:1788837947.776161:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837947.776164:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6999 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.776170:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6999 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837947.776282:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+27:10502:x1875732240316160:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 829us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837947.776290:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 91 00000100:00100000:1.0:1788837947.844972:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837947.851054:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240316416 00000100:00100000:3.0:1788837947.851071:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240316416 00000100:00100000:3.0:1788837947.851181:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 92 00000100:00100000:3.0:1788837947.851191:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+27:10505:x1875732240316416:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788837947.851245:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837947.851267:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48aa00/0x2deb895b363e69a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d0ef expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.851354:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e69a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.851372:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e69a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.851383:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e69a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.851401:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e69ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.851408:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e69ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.851413:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e69ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.851687:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e69b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.851696:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e69b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.851703:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e69b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837947.851720:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788837947.851827:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e69a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.851835:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e69a7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.851842:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e69a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.851848:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48b200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837947.851853:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e69a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.851860:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e69a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.851872:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:3.0:1788837947.851875:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837947.851879:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e69a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.851885:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e69a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.851896:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e69ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.851902:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e69ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.851918:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e69ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.851923:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48ac00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837947.851926:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e69ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.851933:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e69ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.851940:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a460c5e500) 00010000:00010000:3.0:1788837947.851943:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837947.851945:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e69ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.851950:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e69ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.851991:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48aa00/0x2deb895b363e69a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0ef expref: 30 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.852006:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e69b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0ef expref: 29 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.852013:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a448b3cb00) 00010000:00010000:3.0:1788837947.852015:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788837947.852018:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48a200, rc 0) 00000100:00100000:3.0:1788837947.852096:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+29:10505:x1875732240316416:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 906us (7143us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1788837947.852113:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 92 00000100:00100000:3.0:1788837947.856735:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837947.856850:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240316544 00000100:00100000:2.0:1788837947.856861:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240316544 00000100:00100000:2.0:1788837947.856923:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 93 00000100:00100000:2.0:1788837947.856933:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+29:10505:x1875732240316544:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:2.0:1788837947.857415:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e69c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.857435:0:10730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6968 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0da expref: 29 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.857445:0:10730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e69c3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.857483:0:10730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6968 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0da expref: 29 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.857520:0:10730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6968 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0da expref: 29 pid: 5808 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837947.857536:0:10730:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7e7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10730:1875732255017344:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788837947.857685:0:10730:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a44709b840 going to sleep for 11 seconds 00000100:00100000:3.0:1788837947.868587:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837947.868728:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240316800 00000100:00100000:2.0:1788837947.868740:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240316800 00000100:00100000:2.0:1788837947.868810:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:2.0:1788837947.868820:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+30:5588:x1875732240316800:12345-192.168.204.54@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788837947.869187:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+31:5588:x1875732240316800:12345-192.168.204.54@tcp:35:ldlm_bl.0 Request processed in 368us (610us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788837947.869195:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:0.0:1788837947.873053:0:10730:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7e7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10730:1875732255017344:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788837947.873088:0:10730:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e69c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837947.875451:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837947.875631:0:7599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240316928 00000100:00100000:0.0:1788837947.875644:0:7599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240316928 00010000:00010000:0.0:1788837947.875691:0:7599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6968 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0da expref: 31 pid: 5808 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837947.875794:0:7599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:0.0:1788837947.875805:0:7599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+31:2352:x1875732240316928:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837947.875819:0:7599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837947.875827:0:7599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6968 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0da expref: 31 pid: 5808 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837947.875840:0:7599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6968 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0da expref: 31 pid: 5808 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837947.875863:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6968 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0da expref: 31 pid: 5808 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837947.875879:0:7599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a448b3cb00) 00010000:00010000:0.0:1788837947.875884:0:7599:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e69c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837947.875893:0:7599:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e69c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837947.875901:0:7599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e69c3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837947.875933:0:7599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837947.876027:0:7599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+30:2352:x1875732240316928:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 223us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837947.876035:0:7599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 48 00010000:00010000:2.0:1788837947.877565:0:10730:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e69c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.877581:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e69c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.877617:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e69c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.877624:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e69c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.877631:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e69c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.877656:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5c00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837947.877660:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e69c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.877668:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e69c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.877682:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a448b3cb00) 00010000:00010000:2.0:1788837947.877685:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788837947.877689:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e69c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.877695:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e69c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837947.877786:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+29:10505:x1875732240316544:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 20838us (21042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837947.877796:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 93 00000100:00100000:2.0:1788837947.888819:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837947.888904:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240317184 00000100:00100000:3.0:1788837947.888915:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240317184 00000100:00100000:3.0:1788837947.888982:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:3.0:1788837947.888992:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+29:10505:x1875732240317184:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1788837947.889491:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+30:10505:x1875732240317184:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 499us (679us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788837947.889499:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00010000:00010000:0.0:1788837947.939982:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837948.062314:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837948.062496:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240317440 00000100:00100000:2.0:1788837948.062506:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240317440 00000100:00100000:2.0:1788837948.062567:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 94 00000100:00100000:2.0:1788837948.062577:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+30:10516:x1875732240317440:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:2.0:1788837948.062602:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837948.062624:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e69ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d0f6 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.062703:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e69d1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.062731:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e69d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.062742:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e69d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.062757:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e69d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.062776:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e69d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.062784:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e69d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.063067:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e69df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.063076:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e69df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.063084:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e69df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837948.063104:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788837948.063192:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e69d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.063230:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e69d1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.063238:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e69d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.063250:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5800 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837948.063254:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e69d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.063262:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e69d1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.063274:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:2.0:1788837948.063277:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837948.063282:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e69d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.063288:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e69d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.063301:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e69d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.063307:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e69d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.063312:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e69d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.063317:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4e00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837948.063319:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e69d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.063324:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e69d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.063341:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a448b3c800) 00010000:00010000:2.0:1788837948.063343:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837948.063346:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e69d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.063352:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e69d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.063391:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e69ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0f6 expref: 33 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.063405:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e69df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0f6 expref: 32 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.063412:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a448b3cb00) 00010000:00010000:2.0:1788837948.063414:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837948.063417:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4200, rc 0) 00000100:00100000:2.0:1788837948.063476:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+32:10516:x1875732240317440:12345-192.168.204.54@tcp:101:cat.0 Request processed in 901us (1174us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1788837948.063483:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 94 00000100:00100000:2.0:1788837948.079561:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837948.079662:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240317696 00000100:00100000:1.0:1788837948.079673:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240317696 00000100:00100000:1.0:1788837948.079735:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:1.0:1788837948.079745:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+32:10516:x1875732240317696:12345-192.168.204.54@tcp:35:cat.0 00000100:00100000:1.0:1788837948.080018:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+33:10516:x1875732240317696:12345-192.168.204.54@tcp:35:cat.0 Request processed in 274us (468us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1788837948.080025:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:0.0:1788837948.128913:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837948.129136:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240317952 00000100:00100000:2.0:1788837948.129148:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240317952 00000100:00100000:2.0:1788837948.129243:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 95 00000100:00100000:2.0:1788837948.129254:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+33:10517:x1875732240317952:12345-192.168.204.54@tcp:36:rm.0 00010000:00010000:2.0:1788837948.129312:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788837948.129341:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e69df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0f6 expref: 33 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.129381:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e69b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0ef expref: 32 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.129394:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e697d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0e1 expref: 31 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.129405:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a448b3cb00) 00010000:00010000:2.0:1788837948.129416:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837948.129439:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e69ed lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.129452:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e69ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.129462:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e69ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.129475:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e69f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.129482:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e69f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.129490:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e69f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.129739:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e69fb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.129747:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e69fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.129759:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e69fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788837948.133693:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1788837948.133707:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 328227503536ns, next at 329227500376ns, rc = 0 00010000:00010000:2.0:1788837948.133800:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6a02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.133818:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6a02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.133831:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6a02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.133840:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6a02 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.133846:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6a02 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.133853:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6a02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.136967:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788837948.140147:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e69fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.140169:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e69fb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.140178:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e69fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.140220:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4400 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837948.140225:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e69fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.140233:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e69fb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.140252:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a448b3c400) 00010000:00010000:2.0:1788837948.140255:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788837948.140260:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e69fb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.140267:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e69fb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.140298:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e69ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.140304:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e69ed lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.140310:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e69ed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.140314:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4e00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837948.140317:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e69ed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.140323:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e69ed lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.140342:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:2.0:1788837948.140344:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837948.140348:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e69ed lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.140353:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e69ed lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837948.140364:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001bc5e9da reply state 0000000007c443f1 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e69f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837948.140373:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788837948.140495:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+32:10517:x1875732240317952:12345-192.168.204.54@tcp:36:rm.0 Request processed in 11236us (11585us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788837948.140506:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 95 00010000:00010000:0.0:1788837948.145116:0:7597:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837948.145132:0:7597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6a02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.145143:0:7597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4000 already unused, calling callback (ffffffffc1616420) 00010000:00010000:0.0:1788837948.145148:0:7597:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6a02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.145158:0:7597:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6a02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.145176:0:7597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a448b3c400) 00010000:00010000:0.0:1788837948.145179:0:7597:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788837948.145184:0:7597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6a02 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.145190:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6a02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.145230:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837948.145233:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837948.145235:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837948.151475:0:3257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e69f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837948.151495:0:3257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e69f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837948.151503:0:3257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e69f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837948.151509:0:3257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5800 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837948.151532:0:3257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e69f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837948.151540:0:3257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e69f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837948.151557:0:3257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a448b3c800) 00010000:00010000:1.0:1788837948.151560:0:3257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837948.151565:0:3257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e69f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837948.151571:0:3257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e69f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837948.241909:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837948.242159:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240318208 00000100:00100000:2.0:1788837948.242170:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240318208 00000100:00100000:2.0:1788837948.242263:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 96 00000100:00100000:2.0:1788837948.242274:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+31:10523:x1875732240318208:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788837948.242299:0:10730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837948.242320:0:10730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6a09 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d0fd expref: -99 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.242443:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6a10 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.242458:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6a10 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.242489:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6a10 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.242503:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6a17 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.242510:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6a17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.242516:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6a17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788837948.243382:0:10730:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788837948.243563:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6a1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.243577:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6a1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.243586:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6a1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.243618:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6a10 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.243625:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6a10 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.243632:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6a10 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.243637:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4400 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837948.243650:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6a10 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.243659:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6a10 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.243671:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:2.0:1788837948.243674:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837948.243679:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6a10 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.243685:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6a10 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837948.243697:0:10730:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000074aff22d reply state 0000000076236e19 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6a17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837948.243706:0:10730:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788837948.243735:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6a09 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0fd expref: 34 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.243748:0:10730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6a1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0fd expref: 33 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.243756:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:2.0:1788837948.243758:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837948.243772:0:10730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4200, rc 0) 00000100:00100000:2.0:1788837948.243859:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+34:10523:x1875732240318208:12345-192.168.204.54@tcp:101:bash.0 Request processed in 1586us (1959us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788837948.243867:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 96 00010000:00010000:0.0:1788837948.249505:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6a17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.249523:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6a17 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.249548:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6a17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.249555:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837948.249560:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6a17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.249569:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6a17 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.249589:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a448b3cb00) 00010000:00010000:0.0:1788837948.249594:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837948.249599:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6a17 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.249605:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6a17 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837948.251787:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837948.252562:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240318336 00000100:00100000:2.0:1788837948.252573:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240318336 00000100:00100000:2.0:1788837948.252653:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:2.0:1788837948.252664:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2352:x1875732240318336:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788837948.252685:0:6652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837948.252705:0:6652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb88c4be/0x2deb895b363e6a2c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d104 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788837948.252733:0:6652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788837948.252753:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=328s v=(0 0) 00010000:00010000:2.0:1788837948.252758:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837948.252779:0:6652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb88c4be/0x2deb895b363e6a2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d104 expref: 6 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.252800:0:6652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bb88c4be/0x2deb895b363e6a2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d104 expref: 6 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.252813:0:6652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5600, rc 0) 00000100:00100000:2.0:1788837948.252881:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2352:x1875732240318336:12345-192.168.204.54@tcp:101:bash.0 Request processed in 219us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837948.252889:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00080000:3.0:1788837948.253409:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837948.259680:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837948.259861:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240318464 00000100:00100000:3.0:1788837948.259871:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240318464 00000100:00100000:3.0:1788837948.259928:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:3.0:1788837948.259938:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:10523:x1875732240318464:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1788837948.259966:0:6650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837948.259987:0:6650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb498f4b/0x2deb895b363e6a33 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d10b expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837948.260130:0:6650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb88c4be/0x2deb895b363e6a2c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d104 expref: 7 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837948.260140:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837948.260144:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837948.260149:0:6650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb498f4b/0x2deb895b363e6a33 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d10b expref: 7 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837948.260197:0:6650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bb88c4be/0x2deb895b363e6a2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d104 expref: 7 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837948.260250:0:6650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bb88c4be/0x2deb895b363e6a2c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d104 expref: 7 pid: 6652 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837948.260264:0:6650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b850380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6650:1875732255017472:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788837948.260355:0:6650:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b66e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788837948.265471:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837948.265567:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240318592 00000100:00100000:2.0:1788837948.265577:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240318592 00010000:00010000:2.0:1788837948.265629:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bb88c4be/0x2deb895b363e6a2c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d104 expref: 8 pid: 6652 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837948.265694:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:2.0:1788837948.265704:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4497d4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:2351:x1875732240318592:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837948.265720:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837948.265743:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bb88c4be/0x2deb895b363e6a2c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d104 expref: 8 pid: 6652 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.265757:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bb88c4be/0x2deb895b363e6a2c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d104 expref: 8 pid: 6652 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.265798:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837948.265803:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837948.265813:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb498f4b/0x2deb895b363e6a33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d10b expref: 8 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.265824:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb498f4b/0x2deb895b363e6a33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d10b expref: 8 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.265867:0:5795:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cb498f4b/0x2deb895b363e6a33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d10b expref: 8 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837948.265882:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7e4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5795:1875732255017600:192.168.204.54@tcp:105: 00000100:00100000:2.0:1788837948.265988:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a3476e6840 going to sleep for 11 seconds 00010000:00010000:3.0:1788837948.266938:0:6650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb88c4be/0x2deb895b363e6a2c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d104 expref: 8 pid: 6652 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837948.267112:0:6650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b850380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6650:1875732255017472:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788837948.267140:0:6650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cb498f4b/0x2deb895b363e6a33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d10b expref: 7 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837948.267152:0:6650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48aa00, rc 0) 00000100:00100000:3.0:1788837948.267290:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:10523:x1875732240318464:12345-192.168.204.54@tcp:101:bash.0 Request processed in 7353us (7618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837948.267300:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:1.0:1788837948.280981:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837948.281123:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240318848 00000100:00100000:0.0:1788837948.281133:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240318848 00000100:00100000:0.0:1788837948.281192:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:0.0:1788837948.281229:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+33:10523:x1875732240318848:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:0.0:1788837948.281565:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+34:10523:x1875732240318848:12345-192.168.204.54@tcp:35:bash.0 Request processed in 364us (597us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788837948.281574:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:3.0:1788837948.282003:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7e4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5795:1875732255017600:192.168.204.54@tcp:105: 00010000:00010000:3.0:1788837948.282027:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837948.282054:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4497d4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2351:x1875732240318592:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 16352us (16593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837948.282079:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:1.0:1788837948.519499:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837948.519890:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240318976 00000100:00100000:3.0:1788837948.519906:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240318976 00000100:00100000:3.0:1788837948.519994:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 97 00000100:00100000:3.0:1788837948.520007:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+34:10539:x1875732240318976:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788837948.520043:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837948.520475:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6a3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d112 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837948.520566:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6a41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837948.520584:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6a41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837948.520598:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6a41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837948.520641:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788837948.520645:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788837948.520669:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6a41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837948.520700:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6a3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d112 expref: 36 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837948.520723:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6a41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d112 expref: 35 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837948.520768:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:3.0:1788837948.520772:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788837948.520776:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48ac00, rc 0) 00000100:00100000:3.0:1788837948.520851:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+35:10539:x1875732240318976:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 847us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837948.520859:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 97 00000100:00100000:0.0:1788837948.533543:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837948.533717:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240319232 00000100:00100000:2.0:1788837948.533731:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240319232 00000100:00100000:2.0:1788837948.533852:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 98 00000100:00100000:2.0:1788837948.533864:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+35:10539:x1875732240319232:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788837948.534030:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837948.534060:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6a48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d119 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.536460:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6a4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.537422:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.537448:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837948.537476:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788837948.537709:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6a48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d119 expref: 38 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.537736:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6a4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d119 expref: 37 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.537747:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:2.0:1788837948.537751:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837948.537766:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4400, rc 0) 00000100:00100000:2.0:1788837948.538397:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+37:10539:x1875732240319232:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 4530us (4865us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788837948.538408:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 98 00000100:00100000:0.0:1788837948.555114:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837948.555483:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240319360 00000100:00100000:1.0:1788837948.555510:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240319360 00000100:00100000:1.0:1788837948.555612:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:1.0:1788837948.555626:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+37:2352:x1875732240319360:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837948.555646:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837948.555682:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6a4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d119 expref: 37 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837948.555713:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:1.0:1788837948.555720:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837948.555809:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+36:2352:x1875732240319360:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 186us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837948.555830:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:1.0:1788837948.558606:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837948.558744:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240319616 00000100:00100000:0.0:1788837948.558768:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240319616 00000100:00100000:0.0:1788837948.558846:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 99 00000100:00100000:0.0:1788837948.558860:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+36:10539:x1875732240319616:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788837948.558905:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837948.558935:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e6a5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d120 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.560116:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6a64 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.560137:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6a64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.560151:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6a64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837948.560179:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788837948.560383:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e6a5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d120 expref: 39 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.560408:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6a64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d120 expref: 38 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.560420:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:0.0:1788837948.560424:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788837948.560428:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e790200, rc 0) 00000100:00100000:0.0:1788837948.560533:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+38:10539:x1875732240319616:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1675us (1941us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1788837948.560565:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 99 00000100:00100000:2.0:1788837948.566775:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837948.566932:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240319744 00000100:00100000:0.0:1788837948.566956:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240319744 00000100:00100000:0.0:1788837948.567037:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:0.0:1788837948.567050:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2352:x1875732240319744:12345-192.168.204.54@tcp:1:lfs.0 00010000:00010000:0.0:1788837948.567116:0:6652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b25ba15/0x2deb895b363e6a72 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.567145:0:6652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb498f4b/0x2deb895b363e6a33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d10b expref: 6 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.567156:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837948.567162:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788837948.567168:0:6652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b25ba15/0x2deb895b363e6a72 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.567586:0:6652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cb498f4b/0x2deb895b363e6a33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d10b expref: 6 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.567607:0:6652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cb498f4b/0x2deb895b363e6a33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d10b expref: 6 pid: 6650 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837948.567627:0:6652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b0a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6652:1875732255017728:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788837948.567753:0:6652:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a449a34b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788837948.585015:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837948.585164:0:6652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b0a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6652:1875732255017728:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788837948.585269:0:6652:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003b25ba15/0x2deb895b363e6a72 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837948.585364:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240319872 00000100:00100000:1.0:1788837948.585374:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240319872 00002000:00100000:1.0:1788837948.585442:0:6658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff97a46e7e6300 x1875732240319872/t0(0) o4->f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7@192.168.204.54@tcp:604/0 lens 504/0 e 0 to 0 dl 1788837959 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788837948.585452:0:6658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a46e7e6300 with x1875732240319872 ext(0->8) 00010000:00010000:1.0:1788837948.585462:0:6658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000cb498f4b/0x2deb895b363e6a33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d10b expref: 7 pid: 6650 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837948.585478:0:6658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000cb498f4b/0x2deb895b363e6a33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d10b expref: 7 pid: 6650 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788837948.585487:0:6658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff97a46e7e6300 00000100:00100000:1.0:1788837948.585520:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:1.0:1788837948.585532:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2351:x1875732240319872:12345-192.168.204.54@tcp:4:lfs.0 00000100:00100000:1.0:1788837948.586324:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+9:2351:x1875732240319872:12345-192.168.204.54@tcp:4:lfs.0 Request processed in 789us (1321us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788837948.586336:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00002000:00100000:1.0:1788837948.586346:0:6658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff97a46e7e6300 x1875732240319872/t4294967302(0) o4->f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7@192.168.204.54@tcp:604/0 lens 504/448 e 0 to 0 dl 1788837959 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788837948.586357:0:6658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a46e7e6300 with x1875732240319872 ext(0->8) 00010000:00010000:1.0:1788837948.586364:0:6658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000cb498f4b/0x2deb895b363e6a33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d10b expref: 9 pid: 6650 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837948.586395:0:6658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000cb498f4b/0x2deb895b363e6a33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d10b expref: 9 pid: 6650 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788837948.586403:0:6658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff97a46e7e6300 00000100:00100000:1.0:1788837948.596142:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837948.596831:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240320000 00000100:00100000:2.0:1788837948.596845:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240320000 00010000:00010000:2.0:1788837948.596910:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cb498f4b/0x2deb895b363e6a33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d10b expref: 9 pid: 6650 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837948.596981:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:2.0:1788837948.596994:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+9:2351:x1875732240320000:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837948.597014:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788837948.597041:0:5794:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788837948.597044:0:5794:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788837947 00002000:00010000:2.0:1788837948.597047:0:5794:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788837947 00002000:00010000:2.0:1788837948.597049:0:5794:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788837947 00010000:00010000:2.0:1788837948.597057:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cb498f4b/0x2deb895b363e6a33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d10b expref: 9 pid: 6650 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.597074:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cb498f4b/0x2deb895b363e6a33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d10b expref: 9 pid: 6650 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.597107:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb498f4b/0x2deb895b363e6a33 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d10b expref: 9 pid: 6650 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.597131:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788837948.597137:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788837948.597145:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003b25ba15/0x2deb895b363e6a72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.597184:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b25ba15/0x2deb895b363e6a72 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.597291:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837948.597372:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:2351:x1875732240320000:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 380us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837948.597382:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 50 00010000:00010000:0.0:1788837948.598604:0:6652:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003b25ba15/0x2deb895b363e6a72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.598629:0:6652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b25ba15/0x2deb895b363e6a72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.598677:0:6652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b25ba15/0x2deb895b363e6a72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.598687:0:6652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b25ba15/0x2deb895b363e6a72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.598697:0:6652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b25ba15/0x2deb895b363e6a72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.598705:0:6652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e791000 already unused, calling callback (ffffffffc1616420) 00010000:00010000:0.0:1788837948.598710:0:6652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b25ba15/0x2deb895b363e6a72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.598720:0:6652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b25ba15/0x2deb895b363e6a72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.598743:0:6652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b25ba15/0x2deb895b363e6a72 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.598781:0:6652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b25ba15/0x2deb895b363e6a72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837948.598951:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2352:x1875732240319744:12345-192.168.204.54@tcp:1:lfs.0 Request processed in 31889us (32190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837948.598962:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:1.0:1788837948.604352:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837948.604533:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240320256 00000100:00100000:0.0:1788837948.604547:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240320256 00000100:00100000:0.0:1788837948.604615:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:0.0:1788837948.604629:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4713af050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+38:10539:x1875732240320256:12345-192.168.204.54@tcp:35:lfs.0 00000004:00010000:0.0:1788837948.604724:0:5812:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6a64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d120 expref: 38 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788837948.605170:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1788837948.605259:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1788837948.605709:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1788837948.605795:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6a79 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.605816:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6a1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0fd expref: 42 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.605827:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6a79 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.605878:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6a1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0fd expref: 42 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.605917:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6a1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0fd expref: 42 pid: 10730 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837948.605935:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b0a0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5812:1875732255017856:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788837948.606054:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a449a34b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788837948.610129:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b0a0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5812:1875732255017856:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788837948.610177:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6a79 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837948.611971:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837948.612081:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240320384 00000100:00100000:0.0:1788837948.612095:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240320384 00010000:00010000:0.0:1788837948.612151:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6a1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0fd expref: 43 pid: 10730 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837948.612295:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:0.0:1788837948.612307:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+43:2351:x1875732240320384:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837948.612330:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837948.612339:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6a1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0fd expref: 43 pid: 10730 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.612355:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6a1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0fd expref: 43 pid: 10730 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.612384:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6a1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0fd expref: 43 pid: 10730 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.612432:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:0.0:1788837948.612438:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6a79 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.612448:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6a79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.612456:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6a79 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.612494:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837948.612580:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+42:2351:x1875732240320384:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 274us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837948.612589:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 51 00010000:00010000:1.0:1788837948.613334:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6a79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837948.613346:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6a79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788837948.613537:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1788837948.613824:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1788837948.613972:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5812:1875732255017984:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788837948.614089:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837948.614136:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a347307f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788837948.616044:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255017984 00000100:00100000:3.0:1788837948.616075:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255017984 00000100:00100000:3.0:1788837948.616310:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788837948.616326:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5812:x1875732255017984:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788837948.616513:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5812:x1875732255017984:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 190us (2423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837948.616521:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788837948.616646:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837948.616685:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837948.616715:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837948.616744:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240320640 00000100:00100000:3.0:1788837948.616749:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240320640 00000100:00100000:3.0:1788837948.616807:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:3.0:1788837948.616815:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:2351:x1875732240320640:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788837948.616881:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:2351:x1875732240320640:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 66us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837948.616889:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:3.0:1788837948.616908:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240320512 00000100:00100000:3.0:1788837948.616912:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240320512 00000100:00100000:3.0:1788837948.616960:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 293 00000100:00100000:3.0:1788837948.616966:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a521c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2351:x1875732240320512:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788837948.616995:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a521c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2351:x1875732240320512:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 30us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837948.617001:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 293 00000100:00100000:3.0:1788837948.617038:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240320768 00000100:00100000:3.0:1788837948.617043:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240320768 00000100:00100000:3.0:1788837948.617094:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 145 00000100:00100000:3.0:1788837948.617101:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2351:x1875732240320768:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788837948.617133:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2351:x1875732240320768:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 33us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837948.617139:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 145 00000100:00080000:3.0:1788837948.617157:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837948.618374:0:5812:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1788837948.618386:0:5812:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1788837948.618420:0:5812:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97a46019e300, transno 4294967301 00000100:00100000:1.0:1788837948.618438:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5812:1875732255017984:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788837948.619048:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1788837948.619152:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f490a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5812:1875732255018112:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788837948.619266:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837948.619298:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a347307600 going to sleep for 11 seconds 00000100:00100000:0.0:1788837948.619298:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255018112 00000100:00100000:0.0:1788837948.619307:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255018112 00000100:00100000:0.0:1788837948.619369:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788837948.619378:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5812:x1875732255018112:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788837948.619797:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5812:x1875732255018112:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 418us (530us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788837948.619806:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788837948.620094:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f490a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5812:1875732255018112:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788837948.622477:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1788837948.622838:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6a79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.623718:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6a79 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.623735:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6a79 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.623742:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e791c00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837948.623748:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6a79 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.623767:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6a79 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.623790:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:2.0:1788837948.623793:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788837948.623798:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6a79 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.623833:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6a79 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788837948.624467:0:5812:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788837948.629887:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1788837948.630037:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 328723833001ns, next at 329723708808ns, rc = 0 00000001:00080000:2.0:1788837948.630057:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1788837948.630320:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:2.0:1788837948.630326:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788837948.630342:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6a64 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d120 expref: 46 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837948.632427:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4713af050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+45:10539:x1875732240320256:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 27780us (28071us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1788837948.632447:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 26 00000020:00080000:2.0:1788837948.632458:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788837948.638956:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837948.639072:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240320896 00000100:00100000:2.0:1788837948.639085:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240320896 00000100:00100000:2.0:1788837948.639160:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 100 00000100:00100000:2.0:1788837948.639172:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+45:10539:x1875732240320896:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788837948.639269:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837948.639301:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6a80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d127 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.639397:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6a80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d127 expref: 46 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.639442:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6a80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d127 expref: 46 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.639471:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:2.0:1788837948.639475:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788837948.639480:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5e00, rc 0) 00000100:00100000:2.0:1788837948.639560:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+46:10539:x1875732240320896:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 390us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837948.639569:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 100 00000100:00100000:3.0:1788837948.644150:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837948.646124:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240321152 00000100:00100000:1.0:1788837948.646608:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240321152 00000100:00100000:1.0:1788837948.646786:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:1.0:1788837948.646800:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+46:10539:x1875732240321152:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1788837948.647257:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+47:10539:x1875732240321152:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 459us (3123us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1788837948.647266:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:1.0:1788837948.793661:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837948.793803:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240321280 00000100:00100000:2.0:1788837948.793817:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240321280 00000100:00100000:2.0:1788837948.793902:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 101 00000100:00100000:2.0:1788837948.793913:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+47:10549:x1875732240321280:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:2.0:1788837948.794100:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6a87 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.794123:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6a87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.794138:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6a87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.794157:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6a8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.794165:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6a8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.794196:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6a8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.795558:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6a95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.795576:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6a95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.795589:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6a95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837948.796125:0:7972:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6a95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.796145:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6a87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.796152:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6a87 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.796159:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6a87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.796165:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4c00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837948.796170:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6a87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.796178:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6a87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.796194:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:2.0:1788837948.796252:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837948.796260:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6a87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.796267:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6a87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.796287:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6a8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.796294:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6a8e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.796300:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6a8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.796306:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837948.796308:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6a8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.796315:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6a8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.796323:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a448b3c000) 00010000:00010000:2.0:1788837948.796326:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837948.796328:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6a8e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.796334:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6a8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.796353:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6a95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.796366:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6a95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.796372:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6a95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.796377:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5a00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837948.796380:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6a95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.796386:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6a95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.796394:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:2.0:1788837948.796396:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837948.796399:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6a95 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837948.796404:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6a95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837948.796548:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+47:10549:x1875732240321280:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 2629us (2899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837948.796561:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 101 00000100:00100000:3.0:1788837948.895524:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837948.896271:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240321536 00000100:00100000:0.0:1788837948.896290:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240321536 00000100:00100000:0.0:1788837948.896384:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 102 00000100:00100000:0.0:1788837948.896396:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+47:10552:x1875732240321536:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788837948.896427:0:10730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837948.896457:0:10730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6a9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d12e expref: -99 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.896614:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6aa3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.896635:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6aa3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.896665:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6aa3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.896688:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6aaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.896695:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6aaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.896701:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6aaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.896878:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6ab1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.896887:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.896893:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837948.896904:0:10730:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788837948.897062:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6aa3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.897082:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6aa3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.897090:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6aa3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.897097:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e790800 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837948.897102:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6aa3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.897111:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6aa3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.897127:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:0.0:1788837948.897132:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837948.897138:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6aa3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.897145:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6aa3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.897163:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6aaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.897169:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6aaa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.897175:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6aaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.897180:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e790200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837948.897191:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6aaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.897197:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6aaa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.897270:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a462b58c00) 00010000:00010000:0.0:1788837948.897273:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837948.897276:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6aaa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.897282:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6aaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.897337:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6a9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d12e expref: 50 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.897353:0:10730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d12e expref: 49 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.897360:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:0.0:1788837948.897363:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837948.897365:0:10730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e791c00, rc 0) 00000100:00100000:0.0:1788837948.897457:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+49:10552:x1875732240321536:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1061us (1947us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1788837948.897465:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 102 00000100:00100000:3.0:1788837948.904699:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837948.904932:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240321664 00000100:00100000:0.0:1788837948.904949:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240321664 00000100:00100000:0.0:1788837948.905047:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 103 00000100:00100000:0.0:1788837948.905061:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+49:10552:x1875732240321664:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:0.0:1788837948.905239:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e6abf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.905266:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e6abf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.905282:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e6abf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.905321:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e6abf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.905329:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e6abf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.905337:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e6abf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.905344:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e791a00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837948.905349:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e6abf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.905357:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e6abf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.905371:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:0.0:1788837948.905375:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788837948.905380:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e6abf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837948.905386:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e6abf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837948.905509:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+49:10552:x1875732240321664:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 451us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837948.905518:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 103 00000100:00100000:1.0:1788837948.922161:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837948.922798:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240321920 00000100:00100000:2.0:1788837948.922813:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240321920 00000100:00100000:2.0:1788837948.922903:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:2.0:1788837948.922916:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+49:10552:x1875732240321920:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788837948.923358:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+50:10552:x1875732240321920:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 442us (1214us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788837948.923391:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00010000:00010000:2.0:1788837948.962566:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837949.025019:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837949.025247:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240322176 00000100:00100000:1.0:1788837949.025261:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240322176 00000100:00100000:1.0:1788837949.025354:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 104 00000100:00100000:1.0:1788837949.025369:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+50:10562:x1875732240322176:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1788837949.025401:0:7972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837949.025406:0:7972:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788837949.025443:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6a41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d112 expref: 50 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.025469:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:1.0:1788837949.025475:0:7972:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788837949.025492:0:7972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6ac6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d135 expref: -99 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.025625:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6acd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.025641:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6acd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.025864:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6acd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837949.025879:0:7972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788837949.026173:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6ac6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d135 expref: 52 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788837949.026609:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788837949.026659:0:7972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6acd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d135 expref: 51 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.026671:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:1.0:1788837949.026675:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837949.026679:0:7972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3ca00, rc 0) 00000100:00100000:1.0:1788837949.026780:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+51:10562:x1875732240322176:12345-192.168.204.54@tcp:101:bash.0 Request processed in 1414us (1774us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1788837949.026788:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 104 00000100:00100000:3.0:1788837949.036551:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837949.036941:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240322432 00000100:00100000:2.0:1788837949.036956:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240322432 00000100:00100000:2.0:1788837949.037034:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 105 00000100:00100000:2.0:1788837949.037046:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+51:10562:x1875732240322432:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:2.0:1788837949.037129:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788837949.037165:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6acd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d135 expref: 51 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.037192:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e6ab1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d12e expref: 50 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.037449:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:2.0:1788837949.037456:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837949.038172:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6adb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.038195:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6adb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.038243:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6adb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788837949.038317:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1788837949.038348:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce20695c reply state 00000000dde33f83 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6adb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837949.038381:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788837949.038687:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+52:10562:x1875732240322432:12345-192.168.204.54@tcp:36:bash.0 Request processed in 1639us (2147us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788837949.038696:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 105 00000020:00080000:2.0:1788837949.038702:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788837949.042153:0:3257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6adb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.042178:0:3257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6adb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.042187:0:3257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6adb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.042193:0:3257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4c00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837949.042199:0:3257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6adb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.042275:0:3257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6adb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.042299:0:3257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:1.0:1788837949.042302:0:3257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837949.042309:0:3257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6adb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.042317:0:3257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6adb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837949.045881:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837949.048877:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240322560 00000100:00100000:2.0:1788837949.048900:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240322560 00000100:00100000:2.0:1788837949.049119:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 106 00000100:00100000:2.0:1788837949.049133:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+51:10562:x1875732240322560:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788837949.049176:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837949.049221:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e6ae2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d13c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.049378:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6ae9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.049397:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.049412:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837949.049448:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788837949.049452:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837949.049476:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.049510:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e6ae2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d13c expref: 53 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.049549:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d13c expref: 52 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.049560:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:2.0:1788837949.049563:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837949.049568:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4a00, rc 0) 00000100:00100000:2.0:1788837949.049662:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+52:10562:x1875732240322560:12345-192.168.204.54@tcp:101:bash.0 Request processed in 532us (3797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837949.049670:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 106 00000100:00100000:2.0:1788837949.056304:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837949.061764:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240322816 00000100:00100000:1.0:1788837949.061789:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240322816 00000100:00100000:1.0:1788837949.061883:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:1.0:1788837949.061894:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+52:10562:x1875732240322816:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:1.0:1788837949.062608:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+53:10562:x1875732240322816:12345-192.168.204.54@tcp:35:bash.0 Request processed in 712us (6317us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1788837949.062618:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:3.0:1788837949.141398:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837949.141592:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240322944 00000100:00100000:1.0:1788837949.141607:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240322944 00000100:00100000:1.0:1788837949.141698:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 107 00000100:00100000:1.0:1788837949.141712:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+53:10568:x1875732240322944:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788837949.141766:0:7972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837949.141798:0:7972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6af0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d143 expref: -99 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.141890:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6af7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.141930:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6af7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.141945:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6af7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837949.141996:0:7972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788837949.142001:0:7972:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788837949.142025:0:7972:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6af7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.142059:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6af0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d143 expref: 55 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.142082:0:7972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6af7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d143 expref: 54 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.142093:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:1.0:1788837949.142096:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788837949.142101:0:7972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3dc00, rc 0) 00000100:00100000:1.0:1788837949.142676:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+54:10568:x1875732240322944:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 965us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837949.142685:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 107 00000100:00100000:3.0:1788837949.154706:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837949.154921:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240323072 00000100:00100000:2.0:1788837949.154935:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240323072 00000100:00100000:2.0:1788837949.155021:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 108 00000100:00100000:2.0:1788837949.155034:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+54:10568:x1875732240323072:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788837949.155063:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837949.155091:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e6afe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d14a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.155182:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6b05 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.155415:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6b05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.155430:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6b05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.155475:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6b0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.155484:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6b0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.155491:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6b0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.155618:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6b13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.155627:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6b13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.155634:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6b13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837949.155682:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788837949.155687:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837949.155711:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6b13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.155725:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6b13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.155734:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6b05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.155741:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6b05 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.155778:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6b05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.155785:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4400 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837949.155791:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6b05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.155800:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6b05 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.155816:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:2.0:1788837949.155819:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837949.155825:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6b05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.155832:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6b05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.155848:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6b0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.155861:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6b0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.155867:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6b0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.155871:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4e00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837949.155874:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6b0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.155895:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6b0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.155904:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a448b3c000) 00010000:00010000:2.0:1788837949.155906:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837949.155910:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6b0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.155916:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6b0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.155957:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e6afe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d14a expref: 56 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.155974:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6b13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d14a expref: 55 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.155982:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:2.0:1788837949.155984:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837949.155987:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5600, rc 0) 00000100:00100000:2.0:1788837949.156079:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+55:10568:x1875732240323072:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1047us (1386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837949.156088:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 108 00000100:00100000:3.0:1788837949.160168:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837949.160328:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837949.160476:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240323456 00000100:00100000:0.0:1788837949.160493:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240323456 00000100:00100000:0.0:1788837949.160573:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 109 00000100:00100000:0.0:1788837949.160585:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+55:10568:x1875732240323456:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788837949.160616:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837949.160645:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e6b1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d151 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.160808:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6b21 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.160828:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6ae9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d13c expref: 56 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.160837:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6b13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d14a expref: 56 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.160846:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6b21 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.160891:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6b13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d14a expref: 56 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.160908:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6b13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d14a expref: 56 pid: 5809 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837949.160977:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b0a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5808:1875732255018240:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788837949.161265:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240323200 00000100:00100000:1.0:1788837949.161271:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240323200 00010000:00010000:1.0:1788837949.161302:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6b13 lrc: 6/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d14a expref: 57 pid: 5809 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837949.161334:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:1.0:1788837949.161352:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b853b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+57:2352:x1875732240323200:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837949.161365:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837949.161372:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6b13 lrc: 6/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d14a expref: 57 pid: 5809 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.161388:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6b13 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d14a expref: 57 pid: 5809 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.161414:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:1.0:1788837949.161420:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6b21 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.161433:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6b21 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.161440:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837949.162523:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b853b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+57:2352:x1875732240323200:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 1162us (2364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837949.162535:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 52 00010000:00010000:0.0:1788837949.162548:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d13c expref: 57 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.162565:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6ae9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d13c expref: 56 pid: 5808 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837949.162578:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b0a2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5808:1875732255018368:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788837949.162635:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a449a34b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788837949.166875:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837949.167376:0:7599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240323584 00000100:00100000:3.0:1788837949.167390:0:7599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240323584 00010000:00010000:3.0:1788837949.167445:0:7599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6ae9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d13c expref: 57 pid: 5808 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837949.167517:0:7599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:3.0:1788837949.167530:0:7599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+57:2351:x1875732240323584:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837949.167553:0:7599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837949.167562:0:7599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6ae9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d13c expref: 57 pid: 5808 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.167578:0:7599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6ae9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d13c expref: 57 pid: 5808 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.167609:0:7599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:3.0:1788837949.167616:0:7599:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6b21 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.167629:0:7599:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6b21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.167640:0:7599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6b21 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.167666:0:7599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837949.167760:0:7599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+57:2351:x1875732240323584:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 232us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837949.167769:0:7599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 53 00010000:00010000:0.0:1788837949.170294:0:5808:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.54@tcp) returned -22 from blocking AST (req@000000007c0e67d9 x1875732255018240) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6b13 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d14a expref: 56 pid: 5809 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.170329:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6b13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d14a expref: 56 pid: 5809 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837949.170354:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b0a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5808:1875732255018240:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788837949.170378:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6ae9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d13c expref: 55 pid: 5808 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837949.170388:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b0a2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5808:1875732255018368:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788837949.170425:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:0.0:1788837949.170437:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6b21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.170480:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6b21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.170486:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6b21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837949.170516:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788837949.170719:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e6b1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d151 expref: 56 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.170737:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6b21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d151 expref: 55 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.170826:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:0.0:1788837949.170829:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788837949.170832:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e791000, rc 0) 00000100:00100000:0.0:1788837949.171006:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+55:10568:x1875732240323456:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 10412us (10666us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1788837949.171016:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 109 00000100:00100000:2.0:1788837949.179143:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837949.179328:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240323840 00000100:00100000:1.0:1788837949.179341:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240323840 00000100:00100000:1.0:1788837949.179425:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:1.0:1788837949.179438:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+55:10568:x1875732240323840:12345-192.168.204.54@tcp:103:lfs.0 00010000:00010000:1.0:1788837949.179460:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837949.179493:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6a80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d127 expref: 55 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.179516:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:1.0:1788837949.179539:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837949.179645:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+54:10568:x1875732240323840:12345-192.168.204.54@tcp:103:lfs.0 Request processed in 210us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837949.179654:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:1.0:1788837949.182366:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837949.182534:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240323968 00000100:00100000:2.0:1788837949.182550:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240323968 00000100:00100000:2.0:1788837949.182642:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 110 00000100:00100000:2.0:1788837949.182675:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+54:10568:x1875732240323968:12345-192.168.204.54@tcp:58:lfs.0 00010000:00010000:2.0:1788837949.183177:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6b2f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.183337:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6b2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.183354:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6b2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788837949.183630:0:7972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788837949.183878:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+54:10568:x1875732240323968:12345-192.168.204.54@tcp:58:lfs.0 Request processed in 1204us (1527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837949.183888:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 110 00000100:00100000:2.0:1788837949.188025:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837949.188465:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240324096 00000100:00100000:0.0:1788837949.188479:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240324096 00000100:00100000:0.0:1788837949.188551:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 111 00000100:00100000:0.0:1788837949.188564:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+54:10568:x1875732240324096:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788837949.188594:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837949.188626:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e6b36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d158 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.188735:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6b2f lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.188762:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e6b36 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d158 expref: 55 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.188787:0:5809:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6b2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.188803:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e6b36 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d158 expref: 55 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.188821:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:0.0:1788837949.188825:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788837949.188830:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e6b36 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d158 expref: 55 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.188838:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e791a00, rc 0) 00000100:00100000:0.0:1788837949.189161:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+55:10568:x1875732240324096:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 598us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837949.189169:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 111 00000040:00080000:1.0:1788837949.476166:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788837949.476182:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788837949.476309:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788837949.476319:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788837949.476513:0:11659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f493100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875732255018496:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788837949.476667:0:11659:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a347307600 going to sleep for 11 seconds 00000100:00100000:1.0:1788837949.481960:0:11659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f493100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875732255018496:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788837949.483468:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837949.483585:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240324224 00000100:00100000:0.0:1788837949.483599:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240324224 00000100:00100000:0.0:1788837949.483686:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 112 00000100:00100000:0.0:1788837949.483698:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+55:10569:x1875732240324224:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788837949.483757:0:5808:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788837949.483947:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+55:10569:x1875732240324224:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 249us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837949.483955:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 112 00000100:00100000:2.0:1788837949.499697:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837949.499819:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240324352 00000100:00100000:1.0:1788837949.499835:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240324352 00000100:00100000:1.0:1788837949.499929:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 113 00000100:00100000:1.0:1788837949.499943:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+55:10569:x1875732240324352:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788837949.500050:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6b3d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.500085:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6b3d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.500099:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6b3d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.500625:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e6b44 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.500651:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e6b44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.500681:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e6b44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.500732:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6b4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.500751:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6b4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.500759:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6b4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837949.500806:0:7972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788837949.500810:0:7972:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788837949.500823:0:7972:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6b4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.500834:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6b3d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.500841:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6b3d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.500849:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6b3d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.500855:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3c600 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837949.500860:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6b3d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.500868:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6b3d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.500889:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a448b3cf00) 00010000:00010000:1.0:1788837949.500891:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837949.500897:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6b3d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.500903:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6b3d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.500919:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e6b44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.500926:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e6b44 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.500933:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e6b44 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.500938:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3c000 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837949.500941:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e6b44 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.500947:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e6b44 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.500953:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff97a45487f300) 00010000:00010000:1.0:1788837949.500955:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837949.500958:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e6b44 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.500963:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e6b44 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.500989:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6b4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.500996:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6b4b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.501001:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6b4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.501006:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3c400 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837949.501009:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6b4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.501015:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6b4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.501022:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:1.0:1788837949.501024:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837949.501027:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6b4b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.501032:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6b4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837949.501142:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+55:10569:x1875732240324352:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 Request processed in 1198us (1456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837949.501155:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 113 00000100:00100000:1.0:1788837949.509800:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837949.522237:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240324608 00000100:00100000:2.0:1788837949.522252:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240324608 00000100:00100000:2.0:1788837949.522333:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 114 00000100:00100000:2.0:1788837949.522343:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+55:10569:x1875732240324608:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837949.522363:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837949.522383:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6b52 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d15f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.522475:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6b59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.522489:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6b59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.522518:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6b59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837949.522529:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788837949.522621:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6b59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.522628:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6b59 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.522635:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6b59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.522640:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5800 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837949.522644:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6b59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.522650:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6b59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.522661:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:2.0:1788837949.522664:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788837949.522668:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6b59 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.522674:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6b59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.522710:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6b52 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d15f expref: 57 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.522730:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a448b3cf00) 00010000:00010000:2.0:1788837949.522732:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788837949.522735:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6b52 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d15f expref: 57 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.522758:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5200, rc 0) 00000100:00100000:2.0:1788837949.522829:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+56:10569:x1875732240324608:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 486us (13039us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1788837949.522836:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 114 00000100:00100000:3.0:1788837949.531035:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837949.532998:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240324736 00000100:00100000:2.0:1788837949.533015:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240324736 00000100:00100000:2.0:1788837949.533086:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 115 00000100:00100000:2.0:1788837949.533095:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+56:10569:x1875732240324736:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788837949.533131:0:10730:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788837949.533289:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+56:10569:x1875732240324736:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 193us (2269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837949.533298:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 115 00000100:00100000:1.0:1788837949.539495:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837949.540374:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240324992 00000100:00100000:2.0:1788837949.540386:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240324992 00000100:00100000:2.0:1788837949.540454:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00100000:2.0:1788837949.540464:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+56:10569:x1875732240324992:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837949.540483:0:7972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837949.540486:0:7972:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788837949.540514:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6af7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d143 expref: 56 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.540552:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:2.0:1788837949.540557:0:7972:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837949.540571:0:7972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6b67 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d166 expref: -99 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788837949.540979:0:7972:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788837949.541186:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6b6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.541199:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6b6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.541255:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6b6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.541311:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6b67 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d166 expref: 58 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.541327:0:7972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6b6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d166 expref: 57 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.541334:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97a448b3c000) 00010000:00010000:2.0:1788837949.541337:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837949.541340:0:7972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5800, rc 0) 00000100:00100000:2.0:1788837949.541406:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+57:10569:x1875732240324992:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 942us (1921us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788837949.541414:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00100000:1.0:1788837949.551651:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837949.552169:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240325248 00000100:00100000:0.0:1788837949.552187:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240325248 00000100:00100000:0.0:1788837949.552292:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:0.0:1788837949.552304:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+57:10569:x1875732240325248:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788837949.552380:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837949.552407:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6b6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d166 expref: 57 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.552428:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97a448b3c000) 00010000:00010000:0.0:1788837949.552439:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837949.552460:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6b7c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.552503:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6b7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.552514:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6b7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.552529:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6b83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x78991e22 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.552537:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6b83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x78991e22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.552544:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6b83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x78991e22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.552629:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6b7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.552637:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6b7c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.552644:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6b7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.552651:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e790200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837949.552655:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6b7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.552664:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6b7c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.552673:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:0.0:1788837949.552676:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837949.552680:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6b7c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.552700:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6b7c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.552710:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6b83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x78991e22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.552717:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6b83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x78991e22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.552723:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6b83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x78991e22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.552744:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e790800 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837949.552748:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6b83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x78991e22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.552754:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6b83 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x78991e22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.552762:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x78991e22 (ffff97a462b58c00) 00010000:00010000:0.0:1788837949.552765:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837949.552768:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6b83 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x78991e22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.552774:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6b83 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x78991e22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837949.552868:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+56:10569:x1875732240325248:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 565us (1240us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788837949.552876:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:3.0:1788837949.555408:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837949.555528:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240325376 00000100:00100000:0.0:1788837949.555543:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240325376 00000100:00100000:0.0:1788837949.555608:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00100000:0.0:1788837949.555619:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+56:10569:x1875732240325376:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788837949.555640:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837949.555664:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6b8a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d16d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.555701:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e6b91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.555747:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e6b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.555761:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e6b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.555860:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6b8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d16d expref: 58 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.555879:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e6b91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d16d expref: 57 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.555888:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97a462b58600) 00010000:00010000:0.0:1788837949.555890:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788837949.555894:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e790000, rc 0) 00000100:00100000:0.0:1788837949.555972:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+57:10569:x1875732240325376:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 354us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837949.555980:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00100000:1.0:1788837949.560658:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837949.561058:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240325632 00000100:00100000:2.0:1788837949.561077:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240325632 00000100:00100000:2.0:1788837949.561163:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 119 00000100:00100000:2.0:1788837949.561176:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+57:10569:x1875732240325632:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788837949.561339:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6b98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.561363:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6b98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.561378:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6b98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788837949.561710:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1788837949.561725:0:5810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 329655521432ns, next at 330655515789ns, rc = 0 00000004:00010000:2.0:1788837949.561869:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006cfbabd3 reply state 00000000b960063e transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6b98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837949.561881:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788837949.562278:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+59:10569:x1875732240325632:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 1101us (1632us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788837949.562287:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 119 00010000:00010000:0.0:1788837949.568905:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6b98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.568930:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6b98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.568939:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6b98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.568946:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837949.568953:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6b98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.568984:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6b98 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.569007:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97a462b58600) 00010000:00010000:0.0:1788837949.569010:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788837949.569019:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6b98 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.569026:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6b98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837949.578522:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837949.578719:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240325760 00000100:00100000:2.0:1788837949.578733:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240325760 00000100:00100000:2.0:1788837949.578837:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00100000:2.0:1788837949.578849:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+58:10569:x1875732240325760:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837949.578886:0:10730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837949.578917:0:10730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6b9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d174 expref: -99 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.579030:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6b9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d174 expref: 59 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.579048:0:10730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6b9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d174 expref: 59 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.579071:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97a462b58600) 00010000:00010000:2.0:1788837949.579075:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788837949.579080:0:10730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4000, rc 0) 00000100:00100000:2.0:1788837949.579165:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+59:10569:x1875732240325760:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 318us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837949.579174:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00100000:1.0:1788837949.587638:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837949.588146:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240325888 00000100:00100000:0.0:1788837949.588162:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240325888 00000100:00080000:3.0:1788837949.588262:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837949.588305:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:0.0:1788837949.588320:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:2351:x1875732240325888:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788837949.588774:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+9:2351:x1875732240325888:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 455us (1150us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788837949.588784:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:3.0:1788837949.592586:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837949.592786:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240326144 00000100:00100000:2.0:1788837949.592800:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240326144 00000100:00100000:2.0:1788837949.592885:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:2.0:1788837949.592898:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+59:10569:x1875732240326144:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788837949.595197:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+60:10569:x1875732240326144:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 2285us (2616us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788837949.595228:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:1.0:1788837949.605135:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837949.605258:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240326400 00000100:00100000:2.0:1788837949.605270:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240326400 00000100:00100000:2.0:1788837949.605345:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 121 00000100:00100000:2.0:1788837949.605357:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+60:10569:x1875732240326400:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788837949.605530:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+60:10569:x1875732240326400:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 174us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837949.605561:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 121 00000100:00100000:3.0:1788837949.607966:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837949.608244:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240326528 00000100:00100000:2.0:1788837949.608256:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240326528 00000100:00100000:2.0:1788837949.608325:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00100000:2.0:1788837949.608337:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+60:10569:x1875732240326528:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837949.608373:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837949.608402:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6ba6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d17b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.608498:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6bad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.608516:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6bad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.608531:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6bad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837949.608581:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837949.608607:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6bad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.608771:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6ba6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d17b expref: 62 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.608795:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6bad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d17b expref: 61 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.608806:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97a462b58600) 00010000:00010000:2.0:1788837949.608831:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788837949.608836:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5200, rc 0) 00000100:00100000:2.0:1788837949.608912:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+61:10569:x1875732240326528:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 576us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837949.609637:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00100000:1.0:1788837949.614807:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837949.615582:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240326656 00000100:00100000:3.0:1788837949.615598:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240326656 00000100:00100000:3.0:1788837949.615692:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:3.0:1788837949.615705:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+9:2352:x1875732240326656:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788837949.615751:0:6653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837949.615787:0:6653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009590738f/0x2deb895b363e6bb4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d182 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788837949.615833:0:6653:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f803c, blocks: 0x1 00010000:00010000:3.0:1788837949.615863:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=329s v=(0 0) 00010000:00010000:3.0:1788837949.615869:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837949.615882:0:6653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009590738f/0x2deb895b363e6bb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d182 expref: 10 pid: 6653 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.615905:0:6653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009590738f/0x2deb895b363e6bb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d182 expref: 10 pid: 6653 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.616636:0:6653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48ba00, rc 0) 00000100:00100000:3.0:1788837949.616792:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+10:2352:x1875732240326656:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1087us (1995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837949.616802:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:1.0:1788837949.623612:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837949.623954:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240326912 00000100:00100000:0.0:1788837949.623968:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240326912 00000100:00100000:0.0:1788837949.624049:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 123 00000100:00100000:0.0:1788837949.624061:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f493b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+61:10569:x1875732240326912:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788837949.624259:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f493b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+61:10569:x1875732240326912:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 199us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837949.624268:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 123 00000100:00100000:2.0:1788837949.632320:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837949.632417:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240327040 00000100:00100000:1.0:1788837949.632431:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240327040 00000100:00100000:1.0:1788837949.632512:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:1.0:1788837949.632524:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+10:10569:x1875732240327040:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788837949.632550:0:6652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837949.632577:0:6652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d2e590b/0x2deb895b363e6bbb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d189 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.632620:0:6652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009590738f/0x2deb895b363e6bb4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d182 expref: 11 pid: 6653 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.632630:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837949.632635:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837949.632641:0:6652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d2e590b/0x2deb895b363e6bbb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d189 expref: 11 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.632683:0:6652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009590738f/0x2deb895b363e6bb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d182 expref: 11 pid: 6653 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.632699:0:6652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009590738f/0x2deb895b363e6bb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d182 expref: 11 pid: 6653 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837949.632754:0:6652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f491c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6652:1875732255018624:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788837949.632877:0:6652:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a347307600 going to sleep for 11 seconds 00000100:00100000:1.0:1788837949.635315:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837949.635431:0:6652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f491c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6652:1875732255018624:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788837949.635496:0:6652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000d2e590b/0x2deb895b363e6bbb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d189 expref: 11 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.635524:0:6652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3c400, rc 0) 00000100:00100000:0.0:1788837949.635606:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+11:10569:x1875732240327040:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 3084us (3299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837949.635617:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:3.0:1788837949.635888:0:7599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240327168 00000100:00100000:3.0:1788837949.635897:0:7599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240327168 00010000:00010000:3.0:1788837949.635944:0:7599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009590738f/0x2deb895b363e6bb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d182 expref: 11 pid: 6653 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837949.635998:0:7599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:3.0:1788837949.636008:0:7599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4497d6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+11:2352:x1875732240327168:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837949.636025:0:7599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837949.636053:0:7599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009590738f/0x2deb895b363e6bb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d182 expref: 11 pid: 6653 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.636077:0:7599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009590738f/0x2deb895b363e6bb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d182 expref: 11 pid: 6653 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.636106:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009590738f/0x2deb895b363e6bb4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d182 expref: 11 pid: 6653 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.636123:0:7599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837949.636128:0:7599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837949.636138:0:7599:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000d2e590b/0x2deb895b363e6bbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d189 expref: 10 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.636150:0:7599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d2e590b/0x2deb895b363e6bbb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d189 expref: 10 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.636197:0:7599:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000d2e590b/0x2deb895b363e6bbb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d189 expref: 10 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837949.636264:0:7599:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448b77800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7599:1875732255018752:192.168.204.54@tcp:105: 00000100:00100000:3.0:1788837949.636363:0:7599:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b66ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837949.650731:0:7599:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448b77800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7599:1875732255018752:192.168.204.54@tcp:105: 00010000:00010000:3.0:1788837949.650786:0:7599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837949.650883:0:7599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4497d6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+10:2352:x1875732240327168:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 14874us (15578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837949.650896:0:7599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:1.0:1788837949.660552:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837949.660752:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240327296 00000100:00100000:2.0:1788837949.660769:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240327296 00002000:00100000:2.0:1788837949.660840:0:6657:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff97a46f490700 x1875732240327296/t0(0) o4->f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7@192.168.204.54@tcp:605/0 lens 504/0 e 0 to 0 dl 1788837960 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788837949.660856:0:6657:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a46f490700 with x1875732240327296 ext(0->12) 00002000:00010000:2.0:1788837949.660864:0:6657:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97a46f490700 00000100:00100000:2.0:1788837949.660904:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:2.0:1788837949.660915:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+10:2351:x1875732240327296:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788837949.663745:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+12:2351:x1875732240327296:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 Request processed in 2807us (3185us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788837949.663764:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00002000:00100000:2.0:1788837949.663781:0:6657:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff97a46f490700 x1875732240327296/t4294967308(0) o4->f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7@192.168.204.54@tcp:605/0 lens 504/448 e 0 to 0 dl 1788837960 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788837949.663793:0:6657:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a46f490700 with x1875732240327296 ext(0->12) 00002000:00010000:2.0:1788837949.663801:0:6657:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97a46f490700 00000100:00100000:2.0:1788837949.672839:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837949.672994:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240327424 00000100:00100000:0.0:1788837949.673009:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240327424 00000100:00100000:0.0:1788837949.673095:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 124 00000100:00100000:0.0:1788837949.673108:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+61:10569:x1875732240327424:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788837949.726392:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967396 is committed 00000020:00080000:3.0:1788837949.726445:0:5830:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97a347307f00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788837949.726451:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a450a3af00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97a347307e40 00000020:00080000:3.0:1788837949.726455:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a450a3ad00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97a47b646000 00000001:00080000:3.0:1788837949.726500:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1788837949.726510:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:3.0:1788837949.726540:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:3.0:1788837949.726559:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788837949.726585:0:5830:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97a4496f8f00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788837949.726588:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a4474c0100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97a346b713c0 00000020:00080000:3.0:1788837949.726591:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a4474c0800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97a458c79000 00000100:00100000:3.0:1788837949.727054:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448b77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255018880:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788837949.727158:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837949.727286:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47bac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255019008:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788837949.727314:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837949.727343:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837949.727350:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255019136:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788837949.727374:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837949.727439:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255018880 00000100:00100000:3.0:1788837949.727448:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255018880 00000100:00100000:3.0:1788837949.727510:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255019008 00000100:00100000:3.0:1788837949.727514:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255019008 00000100:00100000:3.0:1788837949.727526:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255019136 00000100:00100000:3.0:1788837949.727529:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255019136 00000100:00100000:3.0:1788837949.727551:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788837949.727562:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b189850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3272:x1875732255018880:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788837949.727596:0:6653:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:3.0:1788837949.727648:0:6653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009590738f/0x2deb895b363e6bc2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.727681:0:6653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf3a0f58/0x2deb895b363e6984 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0e8 expref: 11 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.727691:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788837949.727697:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788837949.727702:0:6653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009590738f/0x2deb895b363e6bc2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.727756:0:6653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bf3a0f58/0x2deb895b363e6984 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0e8 expref: 11 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.727773:0:6653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bf3a0f58/0x2deb895b363e6984 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0e8 expref: 11 pid: 6650 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837949.727788:0:6653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6653:1875732255019264:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788837949.727865:0:6653:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b66e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837949.727894:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788837949.727903:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3273:x1875732255019008:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788837949.728105:0:6650:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788837949.728109:0:6650:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788837948 00002000:00010000:3.0:1788837949.728112:0:6650:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788837949.728114:0:6650:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788837948 -> 1788837948 00002000:00010000:3.0:1788837949.728117:0:6650:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788837949.728169:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3273:x1875732255019008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 267us (854us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788837949.728177:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788837949.728235:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788837949.728243:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3273:x1875732255019136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788837949.728258:0:6650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:3.0:1788837949.728286:0:6650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f803b, atime: 0x6a9f803b, ctime: 0x6a9f803b, blocks: 0x1 00010000:00010000:3.0:1788837949.728293:0:6650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9cb053b/0x2deb895b363e6bc9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.728304:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=329s v=(0 0) 00010000:00010000:3.0:1788837949.728308:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837949.728316:0:6650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cb053b/0x2deb895b363e6bc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.728334:0:6650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9cb053b/0x2deb895b363e6bc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.728345:0:6650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9cb053b/0x2deb895b363e6bc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.728364:0:6650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cb053b/0x2deb895b363e6bc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.728387:0:6650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788837949.728984:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3273:x1875732255019136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 740us (1606us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788837949.728993:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1788837949.729030:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788837949.729036:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788837949.729048:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837949.729055:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9cb053b/0x2deb895b363e6bc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.729064:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48b200 already unused, calling callback (ffffffffc1616420) 00010000:00010000:3.0:1788837949.729069:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9cb053b/0x2deb895b363e6bc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.729079:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9cb053b/0x2deb895b363e6bc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.729099:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9cb053b/0x2deb895b363e6bc9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.729107:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9cb053b/0x2deb895b363e6bc9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.729143:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837949.729145:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837949.729147:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788837949.729195:0:3273:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97a46f4d2680/2, rc 0, transno 4294967304 00000100:00100000:3.0:1788837949.729256:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255019136:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788837949.729274:0:3273:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97a47bac1180/2, rc 0, transno 4294967309 00000100:00100000:3.0:1788837949.729279:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47bac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255019008:0@lo:2:osp-syn-0-0.0 00000020:00080000:1.0:1788837949.729947:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788837949.730180:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788837949.733453:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+15:10569:x1875732240327424:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 Request processed in 60328us (60614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837949.733469:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 124 00000100:00100000:2.0:1788837949.737981:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837949.738038:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837949.738253:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240327552 00000100:00100000:1.0:1788837949.738267:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240327552 00010000:00010000:1.0:1788837949.738333:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bf3a0f58/0x2deb895b363e6984 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0e8 expref: 12 pid: 6650 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837949.738400:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:1.0:1788837949.738413:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+12:2352:x1875732240327552:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837949.738437:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837949.738445:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bf3a0f58/0x2deb895b363e6984 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0e8 expref: 12 pid: 6650 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.738462:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bf3a0f58/0x2deb895b363e6984 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0e8 expref: 12 pid: 6650 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.738501:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837949.738506:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837949.738515:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009590738f/0x2deb895b363e6bc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.738550:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009590738f/0x2deb895b363e6bc2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.738579:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837949.738725:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+12:2352:x1875732240327552:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 313us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837949.738808:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:0.0:1788837949.739475:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240327680 00000100:00100000:0.0:1788837949.739486:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240327680 00000100:00100000:0.0:1788837949.739549:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:0.0:1788837949.739560:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+12:2352:x1875732240327680:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1788837949.743360:0:6653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf3a0f58/0x2deb895b363e6984 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0e8 expref: 12 pid: 6650 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837949.743395:0:6653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6653:1875732255019264:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788837949.743431:0:6653:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009590738f/0x2deb895b363e6bc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.749413:0:6653:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009590738f/0x2deb895b363e6bc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.749436:0:6653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009590738f/0x2deb895b363e6bc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.749451:0:6653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009590738f/0x2deb895b363e6bc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.749459:0:6653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009590738f/0x2deb895b363e6bc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.749511:0:6653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788837949.750440:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b189850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3272:x1875732255018880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22870us (23272us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788837949.750455:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1788837949.750862:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837949.750888:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009590738f/0x2deb895b363e6bc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.750903:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48ba00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:2.0:1788837949.750909:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009590738f/0x2deb895b363e6bc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.750922:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009590738f/0x2deb895b363e6bc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.750951:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009590738f/0x2deb895b363e6bc2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.750961:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009590738f/0x2deb895b363e6bc2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.750990:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837949.750992:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837949.750994:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788837949.751327:0:3272:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97a448b77800/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788837949.751337:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448b77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255018880:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1788837949.780407:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1788837949.780430:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:2.0:1788837949.780441:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1788837949.780456:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:1.0:1788837949.781109:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2352:x1875732240327680:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 Request processed in 41542us (43061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837949.781124:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:2.0:1788837949.783890:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837949.784050:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240327936 00000100:00100000:0.0:1788837949.784125:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240327936 00000100:00100000:0.0:1788837949.784465:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 125 00000100:00100000:0.0:1788837949.784479:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+15:10569:x1875732240327936:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788837949.784571:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837949.784611:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6bad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d17b expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.784663:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97a462b58600) 00010000:00010000:0.0:1788837949.784670:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837949.784717:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6bd0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.784746:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6bd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.784758:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6bd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788837949.785578:0:5808:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000203669d9 reply state 0000000069d33507 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6bd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837949.785593:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788837949.785761:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+16:10569:x1875732240327936:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 1282us (1883us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788837949.785770:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 125 00010000:00010000:1.0:1788837949.789343:0:3257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6bd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.789370:0:3257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6bd0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.789380:0:3257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6bd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.789387:0:3257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e791e00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837949.789392:0:3257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6bd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.789401:0:3257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6bd0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.789426:0:3257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97a462b58600) 00010000:00010000:1.0:1788837949.789430:0:3257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837949.789460:0:3257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6bd0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.789467:0:3257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6bd0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837949.789666:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837949.789857:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240328064 00000100:00100000:3.0:1788837949.789870:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240328064 00000100:00100000:3.0:1788837949.792815:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:3.0:1788837949.792846:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2351:x1875732240328064:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788837949.793165:0:6652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788837949.793185:0:6652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788837948 -> 1788837948 00002000:00010000:3.0:1788837949.793188:0:6652:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788837947 00002000:00010000:3.0:1788837949.793190:0:6652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788837948 -> 1788837948 00002000:00010000:3.0:1788837949.793193:0:6652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788837949.793327:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2351:x1875732240328064:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 493us (3665us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788837949.793337:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:2.0:1788837949.798709:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837949.798977:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240328320 00000100:00100000:1.0:1788837949.798991:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240328320 00000100:00100000:1.0:1788837949.799172:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 126 00000100:00100000:1.0:1788837949.799185:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+15:10569:x1875732240328320:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788837949.799342:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6bd7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.799369:0:7972:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e6b91 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d16d expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.799381:0:7972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6bd7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.799431:0:7972:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e6b91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d16d expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.799448:0:7972:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e6b91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d16d expref: 15 pid: 5809 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837949.799465:0:7972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f492a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7972:1875732255019392:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788837949.800054:0:7972:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4618bb780 going to sleep for 11 seconds 00000100:00100000:1.0:1788837949.805358:0:7972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f492a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7972:1875732255019392:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788837949.805402:0:7972:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6bd7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837949.806418:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837949.806537:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240328448 00000100:00100000:0.0:1788837949.806548:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240328448 00010000:00010000:0.0:1788837949.806862:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e6b91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d16d expref: 16 pid: 5809 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837949.806912:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:0.0:1788837949.806933:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+16:2351:x1875732240328448:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837949.806955:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837949.806964:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e6b91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d16d expref: 16 pid: 5809 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.806998:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e6b91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d16d expref: 16 pid: 5809 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.807028:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e6b91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d16d expref: 16 pid: 5809 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.807048:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97a462b58600) 00010000:00010000:0.0:1788837949.807054:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6bd7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.807076:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6bd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.807086:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6bd7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.807176:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837949.807594:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+15:2351:x1875732240328448:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 662us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837949.807704:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 56 00010000:00010000:1.0:1788837949.808220:0:7972:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6bd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.808233:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6bd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.808277:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6bd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.808285:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6bd7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.808292:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6bd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.808300:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3ca00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837949.808305:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6bd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.808314:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6bd7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.808332:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97a462b58600) 00010000:00010000:1.0:1788837949.808336:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788837949.808341:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6bd7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.808346:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6bd7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837949.808413:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+14:10569:x1875732240328320:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 Request processed in 9230us (9721us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788837949.808434:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 126 00000100:00100000:2.0:1788837949.813047:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837949.813260:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240328576 00000100:00100000:3.0:1788837949.813275:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240328576 00000100:00100000:3.0:1788837949.813349:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:3.0:1788837949.813362:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2351:x1875732240328576:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788837949.813579:0:6653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bf3a0f58/0x2deb895b363e6bde lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.813622:0:6653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000d2e590b/0x2deb895b363e6bbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d189 expref: 7 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.813632:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837949.813636:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788837949.813642:0:6653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf3a0f58/0x2deb895b363e6bde lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.813691:0:6653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000d2e590b/0x2deb895b363e6bbb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d189 expref: 7 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.813709:0:6653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000d2e590b/0x2deb895b363e6bbb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d189 expref: 7 pid: 6652 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837949.813728:0:6653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6653:1875732255019520:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788837949.813844:0:6653:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a46e685540 going to sleep for 11 seconds 00000100:00100000:0.0:1788837949.820498:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837949.820781:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240328704 00000100:00100000:1.0:1788837949.820796:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240328704 00010000:00010000:1.0:1788837949.820855:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000d2e590b/0x2deb895b363e6bbb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d189 expref: 8 pid: 6652 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837949.820912:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:1.0:1788837949.820924:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b0a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:2351:x1875732240328704:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837949.820945:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837949.820981:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000d2e590b/0x2deb895b363e6bbb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d189 expref: 8 pid: 6652 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.821001:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000d2e590b/0x2deb895b363e6bbb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d189 expref: 8 pid: 6652 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.821043:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837949.821048:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837949.821056:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf3a0f58/0x2deb895b363e6bde lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.821070:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf3a0f58/0x2deb895b363e6bde lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.821097:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837949.821198:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b0a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:2351:x1875732240328704:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 266us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837949.821254:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 57 00010000:00010000:3.0:1788837949.822127:0:6653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d2e590b/0x2deb895b363e6bbb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d189 expref: 7 pid: 6652 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837949.822230:0:6653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6653:1875732255019520:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788837949.822262:0:6653:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bf3a0f58/0x2deb895b363e6bde lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.822727:0:6653:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bf3a0f58/0x2deb895b363e6bde lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.822749:0:6653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf3a0f58/0x2deb895b363e6bde lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.822797:0:6653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bf3a0f58/0x2deb895b363e6bde lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.822807:0:6653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf3a0f58/0x2deb895b363e6bde lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.822817:0:6653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf3a0f58/0x2deb895b363e6bde lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.822825:0:6653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48a000 already unused, calling callback (ffffffffc1616420) 00010000:00010000:2.0:1788837949.822830:0:6653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf3a0f58/0x2deb895b363e6bde lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.822841:0:6653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf3a0f58/0x2deb895b363e6bde lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.822863:0:6653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf3a0f58/0x2deb895b363e6bde lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.822872:0:6653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf3a0f58/0x2deb895b363e6bde lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837949.823312:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2351:x1875732240328576:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 Request processed in 9949us (10275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837949.823324:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:0.0:1788837949.827067:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837949.827135:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240328960 00000100:00100000:3.0:1788837949.827170:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240328960 00000100:00100000:3.0:1788837949.827277:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 127 00000100:00100000:3.0:1788837949.827291:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b0a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+14:10569:x1875732240328960:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788837949.827423:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6be5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.827449:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6be5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.827463:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6be5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.827774:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6bec lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.827788:0:10730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6b9f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d174 expref: 15 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.827798:0:10730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6bec lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.827845:0:10730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6b9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d174 expref: 15 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.827865:0:10730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6b9f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d174 expref: 15 pid: 10730 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837949.827883:0:10730:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10730:1875732255019648:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788837949.828543:0:10730:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a46e685540 going to sleep for 11 seconds 00000100:00100000:2.0:1788837949.834406:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837949.834501:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240329088 00000100:00100000:0.0:1788837949.834513:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240329088 00010000:00010000:0.0:1788837949.834566:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6b9f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d174 expref: 16 pid: 10730 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837949.834619:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:0.0:1788837949.834650:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+16:2351:x1875732240329088:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837949.834670:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837949.834679:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6b9f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d174 expref: 16 pid: 10730 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.834695:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6b9f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d174 expref: 16 pid: 10730 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.834746:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97a462b58600) 00010000:00010000:0.0:1788837949.834754:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6bec lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.834766:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6bec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.834787:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6bec lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.834814:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837949.834893:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+16:2351:x1875732240329088:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 245us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837949.834901:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 58 00010000:00010000:3.0:1788837949.835058:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6b9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d174 expref: 15 pid: 10730 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837949.836055:0:10730:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10730:1875732255019648:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788837949.836265:0:10730:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6bec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.836280:0:10730:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6bec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837949.836286:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6bec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788837949.836590:0:10730:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1788837949.838378:0:10730:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1788837949.838440:0:10730:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1788837949.838568:0:10730:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10730:1875732255019776:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788837949.841009:0:10730:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837949.841248:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255019776 00000100:00100000:0.0:1788837949.841262:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255019776 00000100:00100000:2.0:1788837949.841417:0:10730:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f9fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837949.842300:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788837949.842323:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10730:x1875732255019776:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788837949.842481:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10730:x1875732255019776:12345-0@lo:1000:mdt00_004.0 Request processed in 167us (1576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837949.842514:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788837949.842631:0:10730:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1788837949.842638:0:10730:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:2.0:1788837949.842663:0:10730:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97a47bac1180, transno 4294967309 00000100:00100000:2.0:1788837949.842680:0:10730:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff97a448b77800 x1875732255018880/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788837965 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837949.842693:0:10730:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10730:1875732255019776:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1788837949.843332:0:10730:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1788837949.843450:0:10730:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10730:1875732255019904:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788837949.843527:0:10730:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837949.844406:0:10730:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4496f8780 going to sleep for 11 seconds 00000100:00100000:1.0:1788837949.844874:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255019904 00000100:00100000:1.0:1788837949.844887:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255019904 00000100:00100000:1.0:1788837949.844966:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788837949.844979:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10730:x1875732255019904:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788837949.848799:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:10730:x1875732255019904:12345-0@lo:1000:mdt00_004.0 Request processed in 3804us (5252us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788837949.848823:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788837949.848846:0:10730:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10730:1875732255019904:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1788837949.848926:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6bec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.848940:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6bec lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.848949:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6bec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.848982:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48ba00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837949.848988:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6bec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.848997:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6bec lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.849018:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97a462b58600) 00010000:00010000:2.0:1788837949.849021:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788837949.849028:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6bec lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.849033:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6bec lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.849081:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6b2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.849088:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6b2f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.849094:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6b2f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.849100:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4e00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837949.849103:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6b2f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.849110:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6b2f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.849128:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:2.0:1788837949.849131:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788837949.849139:0:10730:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e6b36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d158 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.849153:0:10730:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e6b36 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d158 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.849164:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e6b36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d158 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.849241:0:10730:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e6b36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d158 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837949.849258:0:10730:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ec3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10730:1875732255020032:192.168.204.54@tcp:105: 00000100:00100000:2.0:1788837949.849367:0:10730:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4601b2780 going to sleep for 11 seconds 00000100:00100000:2.0:1788837949.854759:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837949.854965:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240329216 00000100:00100000:1.0:1788837949.854979:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240329216 00000100:00100000:1.0:1788837949.855053:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:1.0:1788837949.855066:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+19:10568:x1875732240329216:12345-192.168.204.54@tcp:49:lfs.0 00000100:00100000:1.0:1788837949.855279:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+19:10568:x1875732240329216:12345-192.168.204.54@tcp:49:lfs.0 Request processed in 215us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837949.855288:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:0.0:1788837949.855667:0:10730:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ec3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10730:1875732255020032:192.168.204.54@tcp:105: 00010000:00010000:0.0:1788837949.855838:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6b2f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.855853:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6b2f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.855897:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e6bf3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.855917:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e6bf3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.855930:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e6bf3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.855942:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e6bf3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.855949:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e6bf3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.855956:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e6bf3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.855964:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e790000 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837949.855968:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e6bf3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.855991:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e6bf3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.856007:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:0.0:1788837949.856010:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837949.856015:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e6bf3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.856021:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e6bf3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.856032:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6be5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.856039:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6be5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.856045:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6be5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.856050:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48b200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837949.856127:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6be5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.856136:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6be5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.856147:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:0.0:1788837949.856149:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788837949.856152:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6be5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837949.856168:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6be5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837949.856752:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b0a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+18:10569:x1875732240328960:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 29458us (29694us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1788837949.856765:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 127 00000020:00080000:0.0:1788837949.856772:0:10730:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788837949.856878:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788837949.856884:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788837949.857535:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788837949.857545:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788837949.865524:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837949.865593:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837949.865798:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240329728 00000100:00100000:1.0:1788837949.865813:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240329728 00000100:00100000:1.0:1788837949.865894:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:1.0:1788837949.865907:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4713ad050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+18:10569:x1875732240329728:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788837949.866888:0:5811:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788837949.867019:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1788837949.867080:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6bfa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.867102:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6bfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.867127:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6bfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.867141:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6bfa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.867149:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6bfa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.867156:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6bfa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.867192:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788837949.867354:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4713ad050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+20:10569:x1875732240329728:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 1444us (1754us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1788837949.867366:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 32 00000020:00080000:1.0:1788837949.867374:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788837949.867472:0:7597:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837949.867481:0:7597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6bfa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.867490:0:7597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3ce00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:1.0:1788837949.867496:0:7597:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6bfa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.867506:0:7597:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6bfa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.867521:0:7597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97a45487f300) 00010000:00010000:1.0:1788837949.867525:0:7597:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788837949.867538:0:7597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6bfa lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.867544:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6bfa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.867568:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837949.867570:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837949.867571:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837949.867591:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240329472 00000100:00100000:1.0:1788837949.867600:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240329472 00000100:00100000:1.0:1788837949.867648:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 128 00000100:00100000:1.0:1788837949.867657:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+20:10568:x1875732240329472:12345-192.168.204.54@tcp:58:lfs.0 00000040:00080000:1.0:1788837949.867891:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788837949.867942:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+20:10568:x1875732240329472:12345-192.168.204.54@tcp:58:lfs.0 Request processed in 285us (2438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837949.867950:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 128 00000100:00100000:2.0:1788837949.901901:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837949.902540:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240329856 00000100:00100000:1.0:1788837949.902559:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240329856 00000100:00100000:1.0:1788837949.902666:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 129 00000100:00100000:1.0:1788837949.902678:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+20:10571:x1875732240329856:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788837949.902720:0:7972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837949.902773:0:7972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6c01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d190 expref: -99 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.902873:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e6c08 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.902895:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e6c08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.902932:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e6c08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.902952:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6c0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.902959:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.902964:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.903343:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6c16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.903356:0:7972:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6b21 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d151 expref: 21 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.903366:0:7972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6c16 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.903407:0:7972:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6b21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d151 expref: 21 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.903423:0:7972:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6b21 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d151 expref: 21 pid: 5808 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837949.903438:0:7972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f490380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7972:1875732255020160:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788837949.903567:0:7972:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4600c6180 going to sleep for 11 seconds 00000100:00100000:0.0:1788837949.907988:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837949.908080:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240330112 00000100:00100000:1.0:1788837949.908093:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240330112 00000100:00100000:1.0:1788837949.908410:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:1.0:1788837949.908423:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b0a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+22:5589:x1875732240330112:12345-192.168.204.54@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788837949.909006:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b0a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+23:5589:x1875732240330112:12345-192.168.204.54@tcp:35:ldlm_bl.0 Request processed in 582us (1030us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1788837949.909016:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:2.0:1788837949.912450:0:7972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f490380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7972:1875732255020160:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788837949.912510:0:7972:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6c16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837949.913994:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837949.914338:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240330240 00000100:00100000:2.0:1788837949.914351:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240330240 00010000:00010000:2.0:1788837949.914435:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6b21 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d151 expref: 23 pid: 5808 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837949.914493:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:2.0:1788837949.914506:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f492a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+23:2352:x1875732240330240:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837949.914526:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837949.914533:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6b21 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d151 expref: 23 pid: 5808 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.914549:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6b21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d151 expref: 23 pid: 5808 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.914583:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6b21 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d151 expref: 23 pid: 5808 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.914609:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:2.0:1788837949.914616:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6c16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.914627:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.914636:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6c16 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837949.914684:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837949.914785:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f492a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+22:2352:x1875732240330240:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 281us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837949.914794:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 59 00010000:00010000:1.0:1788837949.917899:0:7972:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.917922:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837949.917988:0:7972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788837949.917993:0:7972:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788837949.918023:0:7972:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.918043:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.918055:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e6c08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.918062:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e6c08 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.918071:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e6c08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.918077:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3d400 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837949.918104:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e6c08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.918125:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e6c08 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.918420:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:1.0:1788837949.918425:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837949.918432:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e6c08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.918440:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e6c08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.918459:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.918465:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6c0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.918471:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6c0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.918475:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3c800 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837949.918478:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6c0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.918483:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6c0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.918491:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a45487f300) 00010000:00010000:1.0:1788837949.918493:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837949.918503:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6c0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.918509:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6c0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.918563:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6c01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d190 expref: 22 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.918579:0:7972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6c16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d190 expref: 21 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837949.918586:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:1.0:1788837949.918588:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837949.918591:0:7972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3ca00, rc 0) 00000100:00100000:1.0:1788837949.918691:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+21:10571:x1875732240329856:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 16014us (16804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837949.918701:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 129 00010000:00010000:2.0:1788837949.989365:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788837950.882820:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788837950.882835:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788837950.882885:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788837950.882892:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788837950.883072:0:11659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b0a0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875732255020288:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788837950.883224:0:11659:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a44709b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788837950.886460:0:11659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b0a0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875732255020288:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788837950.901783:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837950.903155:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240330368 00000100:00100000:3.0:1788837950.903172:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240330368 00000100:00100000:3.0:1788837950.903292:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 130 00000100:00100000:3.0:1788837950.903304:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46019c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+21:10582:x1875732240330368:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788837950.903358:0:10730:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788837950.903520:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46019c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+21:10582:x1875732240330368:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 217us (1751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837950.903530:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 130 00000100:00100000:1.0:1788837950.919518:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837950.919996:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240330624 00000100:00100000:3.0:1788837950.920012:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240330624 00000100:00100000:3.0:1788837950.920096:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 131 00000100:00100000:3.0:1788837950.920109:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+21:10582:x1875732240330624:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788837950.920150:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837950.920183:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6c1d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d197 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837950.920378:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48aa00/0x2deb895b363e6c24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837950.920404:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48aa00/0x2deb895b363e6c24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837950.920427:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48aa00/0x2deb895b363e6c24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837950.920444:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788837950.920650:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6c1d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d197 expref: 24 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837950.920671:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48aa00/0x2deb895b363e6c24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d197 expref: 23 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837950.920685:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:3.0:1788837950.920689:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837950.920694:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48aa00, rc 0) 00000100:00100000:3.0:1788837950.920809:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+23:10582:x1875732240330624:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 702us (1305us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1788837950.920818:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 131 00000100:00100000:3.0:1788837950.925856:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837950.934464:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837950.934543:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240330880 00000100:00100000:3.0:1788837950.934563:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240330880 00000100:00100000:3.0:1788837950.934643:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 132 00000100:00100000:3.0:1788837950.934655:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+23:10582:x1875732240330880:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788837950.934788:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e6c32 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837950.934812:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e6c32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837950.934827:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e6c32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837950.935082:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e6c32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837950.935091:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e6c32 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837950.935098:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e6c32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837950.935105:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48a200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837950.935110:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e6c32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837950.935119:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e6c32 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837950.935134:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:3.0:1788837950.935138:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788837950.935143:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e6c32 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837950.935162:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e6c32 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837950.935416:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+24:10582:x1875732240330880:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 761us (9575us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788837950.935426:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 132 00000040:00080000:3.0:1788837950.935579:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788837950.935585:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788837950.936075:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788837950.936086:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788837950.936652:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240331008 00000100:00100000:2.0:1788837950.936667:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240331008 00000100:00100000:2.0:1788837950.936750:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:2.0:1788837950.936760:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+24:2352:x1875732240331008:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837950.936777:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837950.936805:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48aa00/0x2deb895b363e6c24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d197 expref: 24 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837950.936826:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:2.0:1788837950.936831:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837950.936901:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+23:2352:x1875732240331008:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 140us (6295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837950.936909:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:3.0:1788837950.948331:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837950.948931:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240331264 00000100:00100000:2.0:1788837950.948946:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240331264 00000100:00100000:2.0:1788837950.949070:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:2.0:1788837950.949083:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+23:10582:x1875732240331264:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788837950.949446:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+24:10582:x1875732240331264:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 364us (1130us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1788837950.949470:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 34 00000040:00080000:3.0:1788837950.998803:0:12080:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788837950.998820:0:12080:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788837950.998874:0:12080:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788837950.998882:0:12080:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788837951.025006:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837951.146453:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255020416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837951.146553:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837951.146673:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255020416 00000100:00100000:3.0:1788837951.146684:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255020416 00000100:00100000:3.0:1788837951.146767:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788837951.146779:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3271:x1875732255020416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788837951.146827:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788837951.146879:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3271:x1875732255020416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837951.146886:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1788837951.146916:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837951.146958:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255020416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837951.285964:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837951.286134:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240331520 00000100:00100000:1.0:1788837951.286149:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240331520 00000100:00100000:1.0:1788837951.286286:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 133 00000100:00100000:1.0:1788837951.286299:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46019c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+24:10595:x1875732240331520:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788837951.286336:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837951.286365:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6c39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d19e expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837951.286529:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e6c40 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837951.286550:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e6c40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837951.286564:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e6c40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837951.286578:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788837951.286779:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6c39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d19e expref: 27 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837951.286802:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e6c40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d19e expref: 26 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837951.286812:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:1.0:1788837951.286815:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788837951.286818:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3d400, rc 0) 00000100:00100000:1.0:1788837951.286900:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46019c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+26:10595:x1875732240331520:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 603us (953us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1788837951.286909:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 133 00000100:00080000:3.0:1788837951.287145:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837951.290986:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837951.291084:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240331648 00000100:00100000:2.0:1788837951.291099:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240331648 00000100:00100000:2.0:1788837951.291171:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 134 00000100:00100000:2.0:1788837951.291183:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b0a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+26:10595:x1875732240331648:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:2.0:1788837951.291341:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6c4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837951.291366:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837951.291381:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837951.291417:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837951.291424:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6c4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837951.291432:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6c4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837951.291438:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4c00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837951.291443:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6c4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837951.291452:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6c4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837951.291465:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:2.0:1788837951.291468:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788837951.291474:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6c4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837951.291481:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6c4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837951.291588:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b0a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+26:10595:x1875732240331648:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 406us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837951.291597:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 134 00000100:00100000:1.0:1788837951.390775:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837951.390889:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240331776 00000100:00100000:3.0:1788837951.390913:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240331776 00000100:00100000:3.0:1788837951.391148:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:3.0:1788837951.391161:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2349:x1875732240331776:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:3.0:1788837951.391186:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837951.391261:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b439227f/0x2deb895b363e6c55 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d1a5 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788837951.391348:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1788837951.391399:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f803c, atime: 0x6a9f803b, ctime: 0x6a9f803c, blocks: 0xb 00010000:00010000:2.0:1788837951.391431:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=331s v=(0 0) 00010000:00010000:2.0:1788837951.391436:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837951.391451:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b439227f/0x2deb895b363e6c55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1a5 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837951.391477:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b439227f/0x2deb895b363e6c55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1a5 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837951.391494:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48a200, rc 0) 00000100:00100000:2.0:1788837951.393291:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2349:x1875732240331776:12345-192.168.204.54@tcp:101:cat.0 Request processed in 2110us (2510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837951.393306:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:0.0:1788837951.399808:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837951.400275:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240331904 00000100:00100000:2.0:1788837951.400291:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240331904 00002000:00100000:2.0:1788837951.400368:0:6656:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff97a47b0a2300 x1875732240331904/t0(0) o3->f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7@192.168.204.54@tcp:607/0 lens 488/0 e 0 to 0 dl 1788837962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788837951.400382:0:6656:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a47b0a2300 with x1875732240331904 ext(0->4095) 00002000:00010000:2.0:1788837951.400402:0:6656:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97a47b0a2300 00000100:00100000:2.0:1788837951.400509:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:2.0:1788837951.400520:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b0a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2350:x1875732240331904:12345-192.168.204.54@tcp:3:cat.0 00000100:00100000:2.0:1788837951.400892:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b0a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2350:x1875732240331904:12345-192.168.204.54@tcp:3:cat.0 Request processed in 372us (1101us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788837951.400902:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00002000:00100000:2.0:1788837951.400911:0:6656:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff97a47b0a2300 x1875732240331904/t0(0) o3->f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7@192.168.204.54@tcp:607/0 lens 488/4536 e 0 to 0 dl 1788837962 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788837951.400919:0:6656:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a47b0a2300 with x1875732240331904 ext(0->4095) 00002000:00010000:2.0:1788837951.400923:0:6656:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97a47b0a2300 00010000:00010000:2.0:1788837952.034768:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837952.674718:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255020544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837952.674831:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837952.674935:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255020544 00000100:00100000:1.0:1788837952.674944:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255020544 00000100:00100000:1.0:1788837952.675037:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788837952.675048:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3272:x1875732255020544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837952.675098:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837952.675150:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3272:x1875732255020544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837952.675158:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788837952.677285:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4601bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732255020672:0@lo:400:kworker.0 00000100:00100000:3.0:1788837952.677373:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837952.677420:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732255021184:0@lo:400:kworker.0 00000100:00100000:3.0:1788837952.677450:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837952.679949:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837952.679972:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4601be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732255020800:0@lo:400:kworker.0 00000100:00100000:3.0:1788837952.680053:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837952.680146:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255020672 00000100:00100000:3.0:1788837952.680157:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255020672 00000100:00100000:3.0:1788837952.680303:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788837952.680315:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a520850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3273:x1875732255020672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837952.680378:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a520850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3273:x1875732255020672:12345-0@lo:400:kworker.0 Request processed in 66us (3005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837952.680386:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788837952.680427:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255021184 00000100:00100000:3.0:1788837952.680431:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255021184 00000100:00100000:3.0:1788837952.680465:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255020800 00000100:00100000:3.0:1788837952.680484:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255020800 00000100:00100000:3.0:1788837952.680503:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788837952.680508:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1875732255021184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837952.680540:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1875732255021184:12345-0@lo:400:kworker.0 Request processed in 32us (3089us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837952.680546:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788837952.680556:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788837952.680560:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a347358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732255020800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837952.680581:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a347358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732255020800:12345-0@lo:400:kworker.0 Request processed in 20us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837952.680586:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788837952.680858:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4601be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732255020800:0@lo:400:kworker.0 00000100:00100000:3.0:1788837952.680869:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4601bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732255020672:0@lo:400:kworker.0 00000100:00100000:3.0:1788837952.680879:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732255021184:0@lo:400:kworker.0 00000100:00080000:2.0:1788837952.681479:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788837952.681489:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837952.681514:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255021056:0@lo:400:kworker.0 00000100:00100000:2.0:1788837952.681590:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837952.681658:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255020544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837952.681693:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788837952.681700:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3272:1875732255020928:0@lo:400:kworker.0 00000100:00100000:2.0:1788837952.681732:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837952.681767:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255020928 00000100:00100000:2.0:1788837952.681774:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255020928 00000100:00100000:2.0:1788837952.681835:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788837952.681843:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46019e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1875732255020928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837952.681890:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46019e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1875732255020928:12345-0@lo:400:kworker.0 Request processed in 48us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837952.681899:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:2.0:1788837952.681920:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837952.681940:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3272:1875732255020928:0@lo:400:kworker.0 00000100:00100000:1.0:1788837952.696350:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255021056 00000100:00100000:1.0:1788837952.696371:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255021056 00000100:00100000:1.0:1788837952.696448:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788837952.696460:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46019d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3272:x1875732255021056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837952.696599:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46019d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3272:x1875732255021056:12345-0@lo:400:kworker.0 Request processed in 139us (15007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837952.696608:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788837952.696767:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255021056:0@lo:400:kworker.0 00000001:00080000:2.0:1788837952.789803:0:7611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1788837952.789827:0:7611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:2.0:1788837952.789839:0:7611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00010000:00010000:3.0:1788837953.063605:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837953.734317:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837953.734624:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240332160 00000100:00100000:3.0:1788837953.734643:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240332160 00000100:00100000:3.0:1788837953.734774:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 149 00000100:00100000:3.0:1788837953.734789:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b0a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+26:2351:x1875732240332160:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788837953.734865:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00080000:1.0:1788837953.734945:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837953.734968:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240332416 00000100:00100000:1.0:1788837953.734973:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240332416 00000100:00100000:1.0:1788837953.735027:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:1.0:1788837953.735036:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b0a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2351:x1875732240332416:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788837953.735102:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b0a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2351:x1875732240332416:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 66us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837953.735110:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00080000:1.0:1788837953.735267:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837953.735637:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b0a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+26:2351:x1875732240332160:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 850us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837953.735646:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 149 00000100:00100000:3.0:1788837953.745578:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837953.745673:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240332032 00000100:00100000:3.0:1788837953.745675:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837953.745683:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240332032 00000100:00100000:3.0:1788837953.745716:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837953.745742:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240332288 00000100:00100000:1.0:1788837953.745756:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240332288 00000100:00100000:0.0:1788837953.745768:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 295 00000100:00100000:0.0:1788837953.745783:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a522850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2351:x1875732240332032:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788837953.745794:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240332544 00000100:00100000:3.0:1788837953.745800:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240332544 00000100:00100000:3.0:1788837953.745856:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 150 00000100:00100000:1.0:1788837953.745870:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:3.0:1788837953.745872:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a34735aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2351:x1875732240332544:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788837953.752127:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a347359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2351:x1875732240332288:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788837953.753507:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a347359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2351:x1875732240332288:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 7613us (7820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837953.753535:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00080000:1.0:1788837953.753594:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837953.753603:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837953.758446:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a34735aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2351:x1875732240332544:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 49us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837953.758464:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 150 00000100:00100000:0.0:1788837953.763913:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a522850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2351:x1875732240332032:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 107us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837953.763929:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 295 00010000:00010000:0.0:1788837954.083011:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788837954.820083:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000001:00080000:0.0:1788837954.820104:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1788837954.820120:0:5830:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1788837954.820155:0:5830:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97a448e42240 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788837954.820161:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a459165200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97a448e42480 00000020:00080000:0.0:1788837954.820166:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a459165c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97a47f2cac00 00000020:00080000:2.0:1788837954.821143:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788837954.821494:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1788837955.106765:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788837955.335797:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1788837955.336489:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000040:00080000:3.0:1788837956.068315:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788837956.068330:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788837956.068777:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1788837956.068785:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788837956.131931:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837956.258431:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837956.258465:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a34735b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255021312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837956.258565:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837956.258716:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255021312 00000100:00100000:2.0:1788837956.258730:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255021312 00000100:00100000:2.0:1788837956.258849:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788837956.258872:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a34735a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255021312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837956.258920:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837956.258995:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a34735a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255021312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837956.259004:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1788837956.259030:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837956.264241:0:3273:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1788837956.264261:0:3273:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97a448b77800, transno 4294967310 00000004:00080000:3.0:1788837956.264281:0:3273:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1788837956.264336:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a34735b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255021312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837956.669054:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837956.669495:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240332672 00000100:00100000:3.0:1788837956.669509:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240332672 00000100:00080000:1.0:1788837956.670012:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837956.670083:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 135 00000100:00100000:2.0:1788837956.670162:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46019f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+13:10248:x1875732240332672:12345-192.168.204.54@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788837956.670367:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46019f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+13:10248:x1875732240332672:12345-192.168.204.54@tcp:60:lhsmtool_posix.0 Request processed in 273us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837956.670877:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 135 00000100:00100000:1.0:1788837956.687042:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837956.690505:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240332928 00000100:00100000:0.0:1788837956.690528:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240332928 00000100:00100000:0.0:1788837956.690632:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:0.0:1788837956.690645:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+13:10248:x1875732240332928:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788837956.691313:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+14:10248:x1875732240332928:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 666us (4404us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1788837956.691323:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:1.0:1788837956.965774:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837956.965876:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240333056 00000100:00100000:3.0:1788837956.965890:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240333056 00000100:00100000:3.0:1788837956.965996:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 136 00000100:00100000:3.0:1788837956.966008:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cccdf85-837b-45b2-b451-6b9fb913655f+5:11050:x1875732240333056:12345-192.168.204.54@tcp:101:lsof.0 00010000:00010000:3.0:1788837956.966035:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837956.966062:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6c5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d1ac expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837956.966169:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6c63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837956.966187:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6c63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837956.966236:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6c63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837956.966280:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788837956.966285:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788837956.966335:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6c63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837956.966365:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6c5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1ac expref: 7 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837956.966387:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6c63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1ac expref: 6 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837956.966398:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a462b58500) 00010000:00010000:3.0:1788837956.966401:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788837956.966405:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48b200, rc 0) 00000100:00100000:3.0:1788837956.966484:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cccdf85-837b-45b2-b451-6b9fb913655f+6:11050:x1875732240333056:12345-192.168.204.54@tcp:101:lsof.0 Request processed in 479us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837956.966492:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 136 00000100:00080000:1.0:1788837956.967268:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788837957.156695:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837957.795268:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788837957.795303:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255021440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837957.795406:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837957.795809:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255021440 00000100:00100000:1.0:1788837957.795821:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255021440 00000100:00100000:1.0:1788837957.795935:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788837957.795962:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b0a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255021440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837957.796012:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837957.796080:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b0a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255021440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837957.796089:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788837957.796143:0:3272:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1788837957.796152:0:3272:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1788837957.796183:0:3272:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97a46f4d2680, transno 4294967304 00000100:00100000:1.0:1788837957.796434:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255021440:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788837957.797313:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837957.797968:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46019ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3274:1875732255021824:0@lo:400:kworker.0 00000100:00100000:2.0:1788837957.798045:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837957.798100:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837957.798106:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46019d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3274:1875732255021696:0@lo:400:kworker.0 00000100:00100000:2.0:1788837957.798148:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837957.798178:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46019d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255021952:0@lo:400:kworker.0 00000100:00100000:2.0:1788837957.798411:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837957.798444:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788837957.798451:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46019ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732255021568:0@lo:400:kworker.0 00000100:00100000:2.0:1788837957.798484:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837957.798504:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732255022080:0@lo:400:kworker.0 00000100:00100000:2.0:1788837957.798526:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837957.798555:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255021824 00000100:00100000:2.0:1788837957.798564:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255021824 00000100:00100000:2.0:1788837957.798629:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255021696 00000100:00100000:2.0:1788837957.798633:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255021696 00000100:00100000:2.0:1788837957.798650:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255022080 00000100:00100000:2.0:1788837957.798653:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255022080 00000100:00100000:2.0:1788837957.798673:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788837957.798683:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1875732255021824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837957.798738:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1875732255021824:12345-0@lo:400:kworker.0 Request processed in 56us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837957.798745:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788837957.798778:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788837957.798784:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a477ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1875732255021696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837957.798813:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a477ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1875732255021696:12345-0@lo:400:kworker.0 Request processed in 30us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837957.798819:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788837957.798831:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788837957.798846:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a477ec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1875732255022080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837957.798882:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a477ec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1875732255022080:12345-0@lo:400:kworker.0 Request processed in 37us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837957.798888:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788837957.799130:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255021568 00000100:00100000:3.0:1788837957.799136:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255021568 00000100:00100000:3.0:1788837957.799181:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788837957.799187:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3271:x1875732255021568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837957.799264:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3271:x1875732255021568:12345-0@lo:400:kworker.0 Request processed in 78us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837957.799271:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788837957.799492:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255021952 00000100:00100000:1.0:1788837957.799497:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255021952 00000100:00100000:1.0:1788837957.799537:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788837957.799545:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a477ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255021952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837957.799609:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a477ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255021952:12345-0@lo:400:kworker.0 Request processed in 65us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837957.799616:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788837957.801753:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46019ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732255021568:0@lo:400:kworker.0 00000100:00100000:3.0:1788837957.801838:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732255022080:0@lo:400:kworker.0 00000100:00100000:3.0:1788837957.801855:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46019d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255021952:0@lo:400:kworker.0 00000100:00100000:3.0:1788837957.801916:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46019d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3274:1875732255021696:0@lo:400:kworker.0 00000100:00100000:3.0:1788837957.801929:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46019ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3274:1875732255021824:0@lo:400:kworker.0 00000100:00080000:2.0:1788837957.808654:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788837958.178592:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837958.857706:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837958.857767:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837958.857810:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837958.857830:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837958.857853:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837958.858123:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240333440 00000100:00100000:2.0:1788837958.858140:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240333440 00000100:00100000:2.0:1788837958.858306:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240333568 00000100:00100000:2.0:1788837958.858310:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240333568 00000100:00100000:2.0:1788837958.858356:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:2.0:1788837958.858369:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a34735b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2349:x1875732240333440:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788837958.858479:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a34735b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2349:x1875732240333440:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 113us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837958.858491:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:2.0:1788837958.858510:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:2.0:1788837958.858516:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a347358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2349:x1875732240333568:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788837958.858542:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a347358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2349:x1875732240333568:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 26us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837958.858547:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:2.0:1788837958.858601:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240333696 00000100:00100000:2.0:1788837958.858606:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240333696 00000100:00100000:2.0:1788837958.858638:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240333312 00000100:00100000:2.0:1788837958.858641:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240333312 00000100:00100000:2.0:1788837958.858665:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 154 00000100:00100000:2.0:1788837958.858673:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a34735b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cccdf85-837b-45b2-b451-6b9fb913655f+6:2349:x1875732240333696:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788837958.858708:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a34735b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cccdf85-837b-45b2-b451-6b9fb913655f+6:2349:x1875732240333696:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 36us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837958.858735:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 154 00000100:00100000:2.0:1788837958.858763:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 155 00000100:00100000:2.0:1788837958.858769:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a347359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+14:2349:x1875732240333312:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788837958.858804:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a347359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+14:2349:x1875732240333312:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 35us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837958.858811:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 155 00000100:00080000:2.0:1788837958.859161:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788837958.859168:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788837958.859171:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837958.861919:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240333184 00000100:00100000:1.0:1788837958.861941:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240333184 00000100:00100000:1.0:1788837958.862040:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 297 00000100:00100000:1.0:1788837958.862053:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a523c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2349:x1875732240333184:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788837958.862182:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a523c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2349:x1875732240333184:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 131us (4494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837958.862192:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 297 00010000:00010000:1.0:1788837959.202702:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788837959.914403:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1788837959.914430:0:5830:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1788837959.915314:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788837959.915332:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1788837960.226866:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837961.252966:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837961.383792:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788837961.383821:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255022208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837961.383912:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837961.385849:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255022208 00000100:00100000:1.0:1788837961.385868:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255022208 00000100:00100000:1.0:1788837961.385970:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788837961.385988:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46019ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732255022208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788837961.386045:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837961.386140:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46019ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732255022208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (2226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837961.386148:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788837961.386556:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255022208:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788837961.388484:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1788837961.399566:0:12285:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 23:25:58 (1788837958) 00010000:00010000:0.0:1788837962.276769:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837962.915353:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3274:1875732255022336:0@lo:400:kworker.0 00000100:00100000:1.0:1788837962.915460:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837962.915536:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3274:1875732255022848:0@lo:400:kworker.0 00000100:00100000:1.0:1788837962.915567:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837962.915621:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837962.915628:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255022720:0@lo:400:kworker.0 00000100:00100000:1.0:1788837962.915659:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837962.915697:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732255022464:0@lo:400:kworker.0 00000100:00100000:1.0:1788837962.915724:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837962.915742:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255022976:0@lo:400:kworker.0 00000100:00100000:1.0:1788837962.915763:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837962.915782:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788837962.915788:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a458c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732255022592:0@lo:400:kworker.0 00000100:00100000:1.0:1788837962.915812:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837962.915851:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255022336 00000100:00100000:1.0:1788837962.915860:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255022336 00000100:00100000:1.0:1788837962.915927:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788837962.915938:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3274:x1875732255022336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837962.916001:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3274:x1875732255022336:12345-0@lo:400:kworker.0 Request processed in 64us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837962.916009:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788837962.916045:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255022848 00000100:00100000:1.0:1788837962.916049:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255022848 00000100:00100000:1.0:1788837962.916089:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255022464 00000100:00100000:1.0:1788837962.916092:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255022464 00000100:00100000:1.0:1788837962.916111:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255022592 00000100:00100000:1.0:1788837962.916114:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255022592 00000100:00100000:1.0:1788837962.916133:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788837962.916139:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1875732255022848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837962.916174:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1875732255022848:12345-0@lo:400:kworker.0 Request processed in 36us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837962.916180:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788837962.916226:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788837962.916233:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732255022464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837962.916266:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732255022464:12345-0@lo:400:kworker.0 Request processed in 34us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837962.916272:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788837962.916283:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788837962.916289:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732255022592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837962.916310:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732255022592:12345-0@lo:400:kworker.0 Request processed in 22us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837962.916315:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:1.0:1788837962.916335:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837962.916369:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732255022592:0@lo:400:kworker.0 00000100:00100000:1.0:1788837962.916379:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732255022464:0@lo:400:kworker.0 00000100:00100000:1.0:1788837962.916409:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3274:1875732255022336:0@lo:400:kworker.0 00000100:00100000:1.0:1788837962.916418:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3274:1875732255022848:0@lo:400:kworker.0 00000100:00100000:1.0:1788837962.916455:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255022720 00000100:00100000:1.0:1788837962.916459:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255022720 00000100:00100000:1.0:1788837962.916496:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255022976 00000100:00100000:1.0:1788837962.916500:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255022976 00000100:00100000:1.0:1788837962.916525:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788837962.916532:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732255022720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837962.916566:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732255022720:12345-0@lo:400:kworker.0 Request processed in 35us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837962.916572:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788837962.916582:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788837962.916595:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255022976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837962.916624:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255022976:12345-0@lo:400:kworker.0 Request processed in 31us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837962.916629:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1788837962.916652:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837962.916667:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255022976:0@lo:400:kworker.0 00000100:00100000:1.0:1788837962.916690:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a458c91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255022720:0@lo:400:kworker.0 00000100:00100000:1.0:1788837962.921723:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46019d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255023104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837962.921845:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837962.922076:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255023104 00000100:00100000:3.0:1788837962.922088:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255023104 00000100:00100000:3.0:1788837962.922170:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788837962.922182:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255023104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788837962.922286:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788837962.922343:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255023104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 163us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837962.922351:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788837962.922526:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46019d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255023104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837963.137497:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837963.137697:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240333952 00000100:00100000:1.0:1788837963.137711:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240333952 00000100:00100000:1.0:1788837963.137822:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 137 00000100:00100000:1.0:1788837963.137842:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46019d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+13:11315:x1875732240333952:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788837963.137869:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837963.137896:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6c6a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d1b3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837963.137995:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6c71 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837963.138013:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6c71 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837963.138030:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6c71 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837963.138075:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d800/0x2deb895b363e6c78 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837963.138083:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d800/0x2deb895b363e6c78 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837963.138089:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d800/0x2deb895b363e6c78 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837963.138962:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e6c7f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837963.138980:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e6c7f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837963.138988:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e6c7f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837963.139001:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00000100:00080000:2.0:1788837963.139289:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788837963.139357:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6c71 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837963.139367:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6c71 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837963.139375:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6c71 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837963.139382:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3d000 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837963.139387:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6c71 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837963.139409:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6c71 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837963.139424:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97a45487fd00) 00010000:00010000:1.0:1788837963.139428:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837963.139434:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6c71 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837963.139441:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6c71 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837963.139457:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d800/0x2deb895b363e6c78 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837963.139463:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d800/0x2deb895b363e6c78 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837963.139470:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d800/0x2deb895b363e6c78 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837963.139487:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3d800 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837963.139490:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d800/0x2deb895b363e6c78 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837963.139497:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d800/0x2deb895b363e6c78 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837963.139505:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff97a45487f300) 00010000:00010000:1.0:1788837963.139507:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837963.139511:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d800/0x2deb895b363e6c78 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837963.139527:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d800/0x2deb895b363e6c78 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837963.141511:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6c6a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1b3 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837963.141543:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e6c7f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1b3 expref: 15 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837963.141555:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a448b3cf00) 00010000:00010000:1.0:1788837963.141558:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837963.141562:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3d200, rc 0) 00000100:00100000:1.0:1788837963.141681:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46019d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+15:11315:x1875732240333952:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 3847us (4209us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1788837963.141692:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 137 00000100:00100000:2.0:1788837963.156586:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837963.156659:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240334080 00000100:00100000:2.0:1788837963.156660:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837963.156675:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240334080 00000100:00100000:1.0:1788837963.156759:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 138 00000100:00100000:1.0:1788837963.156772:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a477ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+15:11315:x1875732240334080:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788837963.156944:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a477ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+15:11315:x1875732240334080:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 Request processed in 173us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837963.156954:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 138 00000100:00100000:3.0:1788837963.158581:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240334208 00000100:00100000:3.0:1788837963.158600:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240334208 00000100:00100000:3.0:1788837963.158685:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:3.0:1788837963.158697:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f35450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+15:2351:x1875732240334208:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837963.158716:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837963.158750:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e6c7f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1b3 expref: 15 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837963.159926:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a448b3cf00) 00010000:00010000:3.0:1788837963.159934:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837963.160550:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f35450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+14:2351:x1875732240334208:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 1352us (3386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837963.160564:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000040:00080000:3.0:1788837963.234571:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788837963.234583:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788837963.236618:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788837963.236645:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788837963.298575:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837963.976454:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837963.976572:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837963.976609:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837963.976638:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837963.976668:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837963.976704:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240334848 00000100:00100000:1.0:1788837963.977338:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240334592 00000100:00100000:1.0:1788837963.977352:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240334592 00000100:00100000:1.0:1788837963.977433:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240334720 00000100:00100000:1.0:1788837963.977453:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240334720 00000100:00100000:1.0:1788837963.977497:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:1.0:1788837963.977519:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a477ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2352:x1875732240334592:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788837963.977637:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a477ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2352:x1875732240334592:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 129us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837963.977646:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:1.0:1788837963.977667:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:1.0:1788837963.977676:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a477ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2352:x1875732240334720:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788837963.977703:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a477ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2352:x1875732240334720:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 28us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837963.977709:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:2.0:1788837963.979982:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240334848 00000100:00100000:2.0:1788837963.980094:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240334464 00000100:00100000:2.0:1788837963.980099:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240334464 00000100:00100000:2.0:1788837963.980142:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 159 00000100:00100000:2.0:1788837963.980153:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a477ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1cccdf85-837b-45b2-b451-6b9fb913655f+6:2352:x1875732240334848:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788837963.980279:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a477ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1cccdf85-837b-45b2-b451-6b9fb913655f+6:2352:x1875732240334848:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 128us (3668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837963.980299:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 159 00000100:00100000:2.0:1788837963.980320:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 160 00000100:00100000:2.0:1788837963.980326:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a477ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+14:2352:x1875732240334464:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788837963.980352:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a477ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+14:2352:x1875732240334464:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 27us (3713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837963.980359:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 160 00000100:00080000:2.0:1788837963.980393:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788837963.980399:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788837963.980401:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837963.987632:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240334336 00000100:00100000:3.0:1788837963.987655:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240334336 00000100:00100000:3.0:1788837963.987740:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 299 00000100:00100000:3.0:1788837963.987751:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2352:x1875732240334336:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788837963.987902:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2352:x1875732240334336:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 152us (11465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837963.987911:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 299 00010000:00010000:0.0:1788837964.326315:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788837965.056704:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:3.0:1788837965.349854:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837965.786652:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837965.786964:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240334976 00000100:00100000:1.0:1788837965.786975:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240334976 00000100:00100000:1.0:1788837965.787053:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 139 00000100:00100000:1.0:1788837965.787068:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46019ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+13:11358:x1875732240334976:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788837965.787088:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837965.787109:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e6c8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d1ba expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.787183:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6c94 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.787198:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6c94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.787226:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6c94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.787261:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6c9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.787268:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6c9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.787275:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6c9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.787515:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6c94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.787523:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6c94 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.787528:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6c94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.787534:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3c600 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837965.787539:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6c94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.787547:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6c94 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.787559:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a462b58500) 00010000:00010000:1.0:1788837965.787563:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837965.787568:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6c94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.787575:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6c94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.787594:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6c9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.787600:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6c9b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.787606:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6c9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.787611:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3dc00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837965.787614:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6c9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.787620:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6c9b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.787629:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff97a45487f300) 00010000:00010000:1.0:1788837965.787631:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837965.787634:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6c9b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.787639:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6c9b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.787671:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e6c8d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1ba expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.787680:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a462b58500) 00010000:00010000:1.0:1788837965.787682:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837965.787693:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e6c8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1ba expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.787703:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3c000, rc 0) 00000100:00100000:1.0:1788837965.787888:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46019ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+13:11358:x1875732240334976:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 825us (1245us total) trans 0 rc 301/301 00000100:00100000:1.0:1788837965.787896:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 139 00000100:00080000:3.0:1788837965.788102:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837965.799628:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837965.800027:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240335232 00000100:00100000:0.0:1788837965.800037:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240335232 00000100:00100000:0.0:1788837965.800101:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 140 00000100:00100000:0.0:1788837965.800111:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46019d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+13:11358:x1875732240335232:12345-192.168.204.54@tcp:36:lfs.0 00010000:00010000:0.0:1788837965.800172:0:7972:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837965.800230:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e660b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cff3 expref: 13 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837965.800249:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a462b58500) 00010000:00010000:0.0:1788837965.800254:0:7972:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837965.800474:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6ca2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837965.800488:0:7972:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6c63 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1ac expref: 5 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837965.800496:0:7972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6ca2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837965.800530:0:7972:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6c63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1ac expref: 5 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837965.800543:0:7972:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6c63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1ac expref: 5 pid: 5808 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837965.800557:0:7972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b0a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7972:1875732255023232:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788837965.800643:0:7972:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a44a56f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788837965.810772:0:7972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b0a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7972:1875732255023232:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788837965.810963:0:7972:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6ca2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837965.822223:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837965.822261:0:7599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240335360 00000100:00100000:3.0:1788837965.822271:0:7599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240335360 00010000:00010000:3.0:1788837965.822322:0:7599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6c63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1ac expref: 6 pid: 5808 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837965.822359:0:7599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:3.0:1788837965.822369:0:7599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f492a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1cccdf85-837b-45b2-b451-6b9fb913655f+6:2351:x1875732240335360:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837965.822383:0:7599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837965.822389:0:7599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6c63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1ac expref: 6 pid: 5808 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837965.822414:0:7599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6c63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1ac expref: 6 pid: 5808 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837965.822447:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6c63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1ac expref: 6 pid: 5808 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837965.822462:0:7599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a462b58500) 00010000:00010000:3.0:1788837965.822478:0:7599:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6ca2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837965.822487:0:7599:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6ca2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837965.822493:0:7599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6ca2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837965.822519:0:7599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837965.822566:0:7599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f492a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2351:x1875732240335360:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 198us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837965.822573:0:7599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00080000:3.0:1788837965.822601:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788837965.822672:0:7972:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6ca2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837965.822680:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6ca2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837965.822702:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6ca9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837965.822713:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6ca9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837965.822721:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6ca9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837965.823804:0:7972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788837965.823818:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6ca2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837965.823837:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6ca2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837965.823844:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6ca2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837965.823850:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e791e00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837965.823855:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6ca2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837965.823863:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6ca2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837965.823876:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a462b58500) 00010000:00010000:3.0:1788837965.823879:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837965.823883:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6ca2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837965.823888:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6ca2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788837965.823904:0:7972:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003bbcd793 reply state 00000000c02573af transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6ca9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837965.823913:0:7972:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788837965.823995:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46019d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+14:11358:x1875732240335232:12345-192.168.204.54@tcp:36:lfs.0 Request processed in 23883us (24375us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788837965.824003:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 140 00010000:00010000:3.0:1788837965.836295:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6ca9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837965.836328:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6ca9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837965.836336:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6ca9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837965.836342:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48ac00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837965.836347:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6ca9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837965.836355:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6ca9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837965.836372:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff97a460c5ec00) 00010000:00010000:3.0:1788837965.836376:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837965.836381:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6ca9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837965.836388:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6ca9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837965.907722:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837965.907804:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240335488 00000100:00100000:1.0:1788837965.907813:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240335488 00000100:00100000:1.0:1788837965.907884:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 141 00000100:00100000:1.0:1788837965.907896:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+13:11366:x1875732240335488:12345-192.168.204.54@tcp:101:lctl.0 00010000:00010000:1.0:1788837965.907922:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837965.907949:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e6cb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d1c1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.908026:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6cb7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.908042:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.908056:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837965.908095:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788837965.908099:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788837965.908122:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.908149:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e6cb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1c1 expref: 15 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.908184:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6cb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1c1 expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.908370:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a45487fa00) 00010000:00010000:1.0:1788837965.908373:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788837965.908376:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3dc00, rc 0) 00000100:00100000:1.0:1788837965.908447:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+14:11366:x1875732240335488:12345-192.168.204.54@tcp:101:lctl.0 Request processed in 553us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837965.908454:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 141 00000100:00100000:3.0:1788837965.974364:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837965.974673:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240335616 00000100:00100000:1.0:1788837965.974685:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240335616 00000100:00100000:1.0:1788837965.974761:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 142 00000100:00100000:1.0:1788837965.974773:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+14:11372:x1875732240335616:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1788837965.974797:0:10730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837965.974820:0:10730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e6cbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d1c8 expref: -99 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.974896:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6cc5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.974914:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6cc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.974926:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6cc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.974941:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6ccc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.974964:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6ccc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.974971:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6ccc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.975122:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d800/0x2deb895b363e6cd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.975131:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d800/0x2deb895b363e6cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.975138:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d800/0x2deb895b363e6cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837965.975171:0:10730:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788837965.975176:0:10730:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788837965.975198:0:10730:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d800/0x2deb895b363e6cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.975264:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6cc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.975270:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6cc5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.975278:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6cc5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.975284:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3c600 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837965.975290:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6cc5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.975306:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6cc5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.975321:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a45487fa00) 00010000:00010000:1.0:1788837965.975324:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837965.975329:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6cc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.975335:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6cc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.975354:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6ccc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.975360:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6ccc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.975367:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6ccc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.975372:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3d000 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837965.975375:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6ccc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.975381:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6ccc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.975388:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff97a45487f300) 00010000:00010000:1.0:1788837965.975390:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837965.975393:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6ccc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.975409:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6ccc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.975454:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e6cbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1c8 expref: 16 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.975468:0:10730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d800/0x2deb895b363e6cd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1c8 expref: 15 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.975476:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:1.0:1788837965.975479:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788837965.975481:0:10730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3d800, rc 0) 00000100:00100000:1.0:1788837965.975561:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+15:11372:x1875732240335616:12345-192.168.204.54@tcp:101:bash.0 Request processed in 790us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837965.975569:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 142 00000100:00100000:2.0:1788837965.980607:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837965.980720:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240335872 00000100:00100000:3.0:1788837965.980739:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240335872 00000100:00100000:2.0:1788837965.981579:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 143 00000100:00100000:2.0:1788837965.981591:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a477ec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+15:11372:x1875732240335872:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788837965.981612:0:7972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837965.981636:0:7972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6cda lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d1cf expref: -99 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837965.981958:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6ce1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837965.981973:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6ce1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837965.981985:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6ce1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837965.982058:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6ce8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837965.982068:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837965.982075:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788837965.983040:0:7972:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788837965.983474:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6cef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837965.983489:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837965.983499:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837965.983538:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6ce1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837965.983546:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6ce1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837965.983553:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6ce1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837965.983559:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837965.983564:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6ce1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837965.983585:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6ce1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837965.983599:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:2.0:1788837965.983602:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837965.983607:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6ce1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837965.983613:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6ce1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837965.983628:0:7972:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2196337 reply state 00000000fbe07bf0 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837965.983637:0:7972:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788837965.983677:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6cda lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1cf expref: 18 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837965.983692:0:7972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6cef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1cf expref: 17 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837965.983700:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a448b3c600) 00010000:00010000:2.0:1788837965.983702:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837965.983705:0:7972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4c00, rc 0) 00000100:00100000:2.0:1788837965.984099:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a477ec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+18:11372:x1875732240335872:12345-192.168.204.54@tcp:101:bash.0 Request processed in 2508us (3500us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788837965.984109:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 143 00000100:00100000:2.0:1788837965.989853:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837965.990053:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240336000 00000100:00100000:3.0:1788837965.990064:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240336000 00000100:00100000:3.0:1788837965.990161:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:3.0:1788837965.990183:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a477ec5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2351:x1875732240336000:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1788837965.990251:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837965.990322:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013d31740/0x2deb895b363e6cfd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d1d6 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788837965.990351:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788837965.990373:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=346s v=(0 0) 00010000:00010000:3.0:1788837965.990378:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837965.990388:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013d31740/0x2deb895b363e6cfd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1d6 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837965.990409:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000013d31740/0x2deb895b363e6cfd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1d6 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837965.990433:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48ac00, rc 0) 00000100:00100000:3.0:1788837965.990492:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a477ec5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2351:x1875732240336000:12345-192.168.204.54@tcp:101:bash.0 Request processed in 313us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837965.990500:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00080000:2.0:1788837965.990834:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788837965.991321:0:3257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.991332:0:3257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6ce8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.991339:0:3257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6ce8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.991345:0:3257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4e00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837965.991350:0:3257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6ce8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.991358:0:3257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6ce8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.991381:0:3257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a448b3c100) 00010000:00010000:1.0:1788837965.991384:0:3257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837965.991388:0:3257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6ce8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837965.991395:0:3257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e6ce8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837965.996484:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837965.996897:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240336128 00000100:00100000:2.0:1788837965.996910:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240336128 00000100:00100000:2.0:1788837965.997023:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:2.0:1788837965.997034:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:11372:x1875732240336128:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788837965.997053:0:6650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837965.997074:0:6650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd1bb163/0x2deb895b363e6d04 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d1dd expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837965.997110:0:6650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000013d31740/0x2deb895b363e6cfd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1d6 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837965.997119:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837965.997123:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837965.997129:0:6650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd1bb163/0x2deb895b363e6d04 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1dd expref: 7 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837965.997163:0:6650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000013d31740/0x2deb895b363e6cfd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1d6 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837965.997178:0:6650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000013d31740/0x2deb895b363e6cfd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1d6 expref: 7 pid: 6682 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837965.997236:0:6650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a477ec7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6650:1875732255023360:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788837965.997346:0:6650:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448e43600 going to sleep for 11 seconds 00000100:00100000:2.0:1788837965.999945:0:6650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a477ec7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6650:1875732255023360:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788837965.999980:0:6650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd1bb163/0x2deb895b363e6d04 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1dd expref: 7 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.000010:0:6650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5a00, rc 0) 00000100:00100000:2.0:1788837966.000081:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:11372:x1875732240336128:12345-192.168.204.54@tcp:101:bash.0 Request processed in 3047us (3608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837966.000090:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:3.0:1788837966.002393:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837966.002502:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240336256 00000100:00100000:2.0:1788837966.002513:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240336256 00010000:00010000:2.0:1788837966.002551:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000013d31740/0x2deb895b363e6cfd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1d6 expref: 7 pid: 6682 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837966.002593:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:2.0:1788837966.002603:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2351:x1875732240336256:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837966.002628:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837966.002652:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000013d31740/0x2deb895b363e6cfd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1d6 expref: 7 pid: 6682 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.002665:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000013d31740/0x2deb895b363e6cfd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1d6 expref: 7 pid: 6682 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.002688:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013d31740/0x2deb895b363e6cfd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1d6 expref: 7 pid: 6682 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.002705:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837966.002709:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837966.002718:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd1bb163/0x2deb895b363e6d04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1dd expref: 6 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.002744:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd1bb163/0x2deb895b363e6d04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1dd expref: 6 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.002795:0:5795:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dd1bb163/0x2deb895b363e6d04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1dd expref: 6 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837966.002810:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a477ec7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5795:1875732255023488:192.168.204.54@tcp:105: 00000100:00100000:2.0:1788837966.002892:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448e43600 going to sleep for 11 seconds 00000100:00100000:2.0:1788837966.005805:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a477ec7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5795:1875732255023488:192.168.204.54@tcp:105: 00010000:00010000:2.0:1788837966.005831:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837966.005885:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2351:x1875732240336256:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 3284us (3503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837966.005896:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:3.0:1788837966.012375:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837966.012490:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240336512 00000100:00100000:2.0:1788837966.012501:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240336512 00000100:00100000:2.0:1788837966.012559:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:2.0:1788837966.012570:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+17:11372:x1875732240336512:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:2.0:1788837966.012956:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+18:11372:x1875732240336512:12345-192.168.204.54@tcp:35:bash.0 Request processed in 387us (590us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788837966.012965:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:3.0:1788837966.120734:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837966.121233:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240336768 00000100:00100000:1.0:1788837966.121245:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240336768 00000100:00100000:1.0:1788837966.121320:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 144 00000100:00100000:1.0:1788837966.121330:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+18:11382:x1875732240336768:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788837966.121357:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837966.121379:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e6d0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d1e4 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837966.121651:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788837966.122155:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e6d0b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1e4 expref: 20 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.122172:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a45487fa00) 00010000:00010000:1.0:1788837966.122175:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788837966.122180:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e6d0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1e4 expref: 20 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.122237:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3c000, rc 0) 00000100:00100000:1.0:1788837966.122307:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+19:11382:x1875732240336768:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 978us (1582us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1788837966.122328:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 144 00000100:00100000:3.0:1788837966.126649:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837966.126747:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240337024 00000100:00100000:2.0:1788837966.126758:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240337024 00000100:00100000:2.0:1788837966.126829:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:2.0:1788837966.126839:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+19:11382:x1875732240337024:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788837966.127120:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+20:11382:x1875732240337024:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 281us (481us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1788837966.127128:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:3.0:1788837966.243430:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837966.243548:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240337152 00000100:00100000:2.0:1788837966.243558:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240337152 00000100:00100000:2.0:1788837966.243630:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 145 00000100:00100000:2.0:1788837966.243642:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+20:11388:x1875732240337152:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788837966.243668:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837966.243691:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6d19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d1eb expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.243760:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6d20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.243775:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6d20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.243786:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6d20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837966.243831:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788837966.243835:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837966.243852:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6d20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.243881:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6d19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1eb expref: 22 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.243901:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6d20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1eb expref: 21 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.243923:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:2.0:1788837966.243927:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788837966.243930:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4000, rc 0) 00000100:00100000:2.0:1788837966.243997:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+21:11388:x1875732240337152:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 358us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837966.244003:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 145 00000100:00100000:3.0:1788837966.257133:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837966.257925:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240337408 00000100:00100000:2.0:1788837966.257937:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240337408 00000100:00100000:2.0:1788837966.258012:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 146 00000100:00100000:2.0:1788837966.258023:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+21:11388:x1875732240337408:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788837966.258043:0:7972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837966.258066:0:7972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6d27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d1f2 expref: -99 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.258507:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e6d2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.258523:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e6d2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.258535:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e6d2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837966.258549:0:7972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788837966.258686:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e6d27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1f2 expref: 24 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.258726:0:7972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e6d2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1f2 expref: 23 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.258736:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a448b3c600) 00010000:00010000:2.0:1788837966.258739:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837966.258742:0:7972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4600, rc 0) 00000100:00100000:2.0:1788837966.258893:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+23:11388:x1875732240337408:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 872us (1770us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1788837966.258900:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 146 00000100:00100000:3.0:1788837966.272094:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837966.272248:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240337664 00000100:00100000:1.0:1788837966.272258:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240337664 00000100:00100000:1.0:1788837966.272326:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 147 00000100:00100000:1.0:1788837966.272337:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+23:11388:x1875732240337664:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788837966.272364:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837966.272386:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e6d3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d1f9 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.272501:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6d43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.272517:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6d43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.272528:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6d43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837966.272541:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788837966.272664:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e6d3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1f9 expref: 26 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.272684:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6d43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1f9 expref: 25 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.272692:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a448b3c600) 00010000:00010000:1.0:1788837966.272696:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788837966.272699:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3d000, rc 0) 00000100:00100000:1.0:1788837966.272990:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+25:11388:x1875732240337664:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 653us (911us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1788837966.272998:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 147 00000100:00100000:3.0:1788837966.291577:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837966.291739:0:7599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240337792 00000100:00100000:1.0:1788837966.291749:0:7599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240337792 00000100:00100000:1.0:1788837966.291839:0:7599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:1.0:1788837966.291850:0:7599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+25:2352:x1875732240337792:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837966.291868:0:7599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837966.291893:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e6d2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1f2 expref: 25 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.291912:0:7599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a448b3c600) 00010000:00010000:1.0:1788837966.291917:0:7599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837966.291980:0:7599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+24:2352:x1875732240337792:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 132us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837966.291988:0:7599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:3.0:1788837966.294450:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837966.294548:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240337920 00000100:00100000:1.0:1788837966.294559:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240337920 00000100:00100000:1.0:1788837966.294640:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:1.0:1788837966.294652:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2351:x1875732240337920:12345-192.168.204.54@tcp:1:lfs.0 00010000:00010000:1.0:1788837966.294703:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ae8531a/0x2deb895b363e6d51 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.295097:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd1bb163/0x2deb895b363e6d04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1dd expref: 6 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.295106:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837966.295124:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837966.295129:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ae8531a/0x2deb895b363e6d51 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.295168:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd1bb163/0x2deb895b363e6d04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1dd expref: 6 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.295184:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd1bb163/0x2deb895b363e6d04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1dd expref: 6 pid: 6650 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837966.295199:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6682:1875732255023616:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788837966.295324:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a46e8ebd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788837966.301539:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6682:1875732255023616:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788837966.301589:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006ae8531a/0x2deb895b363e6d51 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837966.306526:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000040:00080000:1.0:1788837966.306772:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788837966.306777:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788837966.306973:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1788837966.306980:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788837966.309074:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240338048 00000100:00100000:0.0:1788837966.309090:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240338048 00002000:00100000:0.0:1788837966.309149:0:6658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff97a44a40e680 x1875732240338048/t0(0) o4->f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7@192.168.204.54@tcp:622/0 lens 504/0 e 0 to 0 dl 1788837977 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788837966.309160:0:6658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a44a40e680 with x1875732240338048 ext(0->12) 00010000:00010000:0.0:1788837966.309170:0:6658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dd1bb163/0x2deb895b363e6d04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1dd expref: 7 pid: 6650 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837966.309199:0:6658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dd1bb163/0x2deb895b363e6d04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1dd expref: 7 pid: 6650 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788837966.309226:0:6658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff97a44a40e680 00000100:00100000:0.0:1788837966.309267:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:0.0:1788837966.309278:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2351:x1875732240338048:12345-192.168.204.54@tcp:4:lfs.0 00000100:00100000:0.0:1788837966.310426:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+9:2351:x1875732240338048:12345-192.168.204.54@tcp:4:lfs.0 Request processed in 1130us (3889us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788837966.310438:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00002000:00100000:0.0:1788837966.310447:0:6658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff97a44a40e680 x1875732240338048/t4294967305(0) o4->f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7@192.168.204.54@tcp:622/0 lens 504/448 e 0 to 0 dl 1788837977 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788837966.310457:0:6658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a44a40e680 with x1875732240338048 ext(0->12) 00010000:00010000:0.0:1788837966.310466:0:6658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dd1bb163/0x2deb895b363e6d04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1dd expref: 9 pid: 6650 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837966.310485:0:6658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dd1bb163/0x2deb895b363e6d04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1dd expref: 9 pid: 6650 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788837966.310494:0:6658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff97a44a40e680 00000100:00100000:2.0:1788837966.318044:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837966.318173:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240338176 00000100:00100000:0.0:1788837966.318184:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240338176 00010000:00010000:0.0:1788837966.318861:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd1bb163/0x2deb895b363e6d04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1dd expref: 9 pid: 6650 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837966.318976:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:0.0:1788837966.318987:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a477ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+9:2352:x1875732240338176:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837966.319004:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788837966.319026:0:5793:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788837966.319029:0:5793:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788837965 00002000:00010000:0.0:1788837966.319031:0:5793:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788837965 00002000:00010000:0.0:1788837966.319033:0:5793:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788837965 00010000:00010000:0.0:1788837966.319039:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd1bb163/0x2deb895b363e6d04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1dd expref: 9 pid: 6650 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837966.319052:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd1bb163/0x2deb895b363e6d04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1dd expref: 9 pid: 6650 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837966.319077:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd1bb163/0x2deb895b363e6d04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1dd expref: 9 pid: 6650 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837966.319095:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788837966.319099:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788837966.319107:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ae8531a/0x2deb895b363e6d51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837966.319118:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ae8531a/0x2deb895b363e6d51 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837966.319245:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837966.319321:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a477ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:2352:x1875732240338176:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 327us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837966.319329:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 62 00010000:00010000:1.0:1788837966.319576:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006ae8531a/0x2deb895b363e6d51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.319599:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ae8531a/0x2deb895b363e6d51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.319636:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ae8531a/0x2deb895b363e6d51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.319645:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ae8531a/0x2deb895b363e6d51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.319654:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ae8531a/0x2deb895b363e6d51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.319661:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3c000 already unused, calling callback (ffffffffc1616420) 00010000:00010000:1.0:1788837966.319665:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ae8531a/0x2deb895b363e6d51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.319675:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ae8531a/0x2deb895b363e6d51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.319688:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ae8531a/0x2deb895b363e6d51 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.319695:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ae8531a/0x2deb895b363e6d51 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837966.319933:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2351:x1875732240337920:12345-192.168.204.54@tcp:1:lfs.0 Request processed in 25281us (25492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837966.319942:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:2.0:1788837966.326371:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837966.326521:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240338432 00000100:00100000:3.0:1788837966.326532:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240338432 00000100:00100000:3.0:1788837966.326714:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:3.0:1788837966.326727:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4713ac450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+24:11388:x1875732240338432:12345-192.168.204.54@tcp:35:lfs.0 00000004:00010000:3.0:1788837966.326827:0:5812:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6d43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1f9 expref: 24 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788837966.327111:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1788837966.327159:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1788837966.327791:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1788837966.327848:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6d58 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837966.327866:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6cef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1cf expref: 28 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837966.327874:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6d58 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837966.327909:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6cef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1cf expref: 28 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837966.327924:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6cef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1cf expref: 28 pid: 7972 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837966.327939:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5812:1875732255023744:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788837966.328026:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a462ab1780 going to sleep for 11 seconds 00000100:00100000:3.0:1788837966.333839:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837966.334091:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5812:1875732255023744:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788837966.334120:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6d58 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837966.334549:0:7599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240338560 00000100:00100000:1.0:1788837966.334558:0:7599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240338560 00010000:00010000:1.0:1788837966.334613:0:7599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6cef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1cf expref: 29 pid: 7972 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837966.334651:0:7599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:1.0:1788837966.334661:0:7599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+29:2351:x1875732240338560:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837966.334677:0:7599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837966.334684:0:7599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6cef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1cf expref: 29 pid: 7972 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.334697:0:7599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6cef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1cf expref: 29 pid: 7972 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.334718:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6cef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1cf expref: 29 pid: 7972 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.334747:0:7599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a448b3c600) 00010000:00010000:1.0:1788837966.334752:0:7599:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6d58 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.334761:0:7599:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6d58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.334768:0:7599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6d58 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.334795:0:7599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837966.334854:0:7599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+28:2351:x1875732240338560:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 193us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837966.334875:0:7599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 63 00010000:00010000:2.0:1788837966.335444:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6d58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.335453:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6d58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788837966.335585:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788837966.336000:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1788837966.336119:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a477ec5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5812:1875732255023872:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788837966.336407:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837966.336448:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a345895e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788837966.336528:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255023872 00000100:00100000:0.0:1788837966.336536:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255023872 00000100:00100000:0.0:1788837966.336606:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788837966.336615:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a477ec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5812:x1875732255023872:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788837966.336694:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a477ec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5812:x1875732255023872:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 81us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837966.336701:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788837966.336949:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837966.337244:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a477ec5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5812:1875732255023872:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788837966.337761:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1788837966.337835:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5812:1875732255024000:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788837966.337881:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837966.337900:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a46e8ebcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837966.338233:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255024000 00000100:00100000:0.0:1788837966.338240:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255024000 00000100:00100000:0.0:1788837966.338284:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788837966.338293:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5812:x1875732255024000:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788837966.338482:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5812:x1875732255024000:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 189us (600us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788837966.338489:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788837966.338818:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5812:1875732255024000:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788837966.338877:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1788837966.338917:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6d58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.338928:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6d58 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.338936:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6d58 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.338943:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48b200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837966.338947:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6d58 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.338956:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6d58 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.338973:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a448b3c600) 00010000:00010000:1.0:1788837966.338976:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788837966.338981:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6d58 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.339000:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6d58 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788837966.339187:0:5812:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788837966.344943:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1788837966.344967:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 346438763452ns, next at 347438758846ns, rc = 0 00000001:00080000:1.0:1788837966.344981:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1788837966.345051:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a448b3c600) 00010000:00010000:1.0:1788837966.345056:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788837966.345067:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6d43 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1f9 expref: 32 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837966.348684:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4713ac450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+31:11388:x1875732240338432:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 21945us (22309us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1788837966.348701:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 38 00000020:00080000:1.0:1788837966.348710:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788837966.357122:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837966.357622:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240338688 00000100:00100000:1.0:1788837966.357635:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240338688 00000100:00100000:1.0:1788837966.357714:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 148 00000100:00100000:1.0:1788837966.357738:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+31:11388:x1875732240338688:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788837966.357763:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837966.357788:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e6d5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d200 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.357850:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e6d5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d200 expref: 32 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.357885:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e6d5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d200 expref: 32 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.357906:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a45487f300) 00010000:00010000:1.0:1788837966.357910:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788837966.357914:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3c000, rc 0) 00000100:00100000:1.0:1788837966.357987:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+32:11388:x1875732240338688:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 264us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837966.357994:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 148 00000100:00100000:2.0:1788837966.364392:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837966.364566:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240338944 00000100:00100000:0.0:1788837966.364577:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240338944 00000100:00100000:0.0:1788837966.364652:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:0.0:1788837966.364663:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a477ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+32:11388:x1875732240338944:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:0.0:1788837966.365154:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a477ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+33:11388:x1875732240338944:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 492us (772us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1788837966.365427:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 39 00010000:00010000:0.0:1788837966.371588:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837966.502508:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44a40ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255024128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837966.502623:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837966.502884:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255024128 00000100:00100000:3.0:1788837966.502896:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255024128 00000100:00100000:3.0:1788837966.502988:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788837966.502999:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255024128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788837966.503046:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788837966.503138:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255024128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837966.503146:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788837966.503233:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44a40ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255024128:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788837966.503312:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837966.535075:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837966.539681:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240339200 00000100:00100000:2.0:1788837966.539705:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240339200 00000100:00100000:2.0:1788837966.539823:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 149 00000100:00100000:2.0:1788837966.539837:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+33:11397:x1875732240339200:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788837966.539872:0:7972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837966.539901:0:7972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6d66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d207 expref: -99 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837966.540033:0:7972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788837966.541773:0:7972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6d66 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d207 expref: 35 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.541800:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a45487fa00) 00010000:00010000:2.0:1788837966.541804:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788837966.541811:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6d66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d207 expref: 35 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.541830:0:7972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4a00, rc 0) 00000100:00100000:2.0:1788837966.541935:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+34:11397:x1875732240339200:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 2101us (6877us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1788837966.541946:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 149 00000100:00100000:3.0:1788837966.547712:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837966.554095:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240339328 00000100:00100000:1.0:1788837966.554113:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240339328 00000100:00100000:1.0:1788837966.554232:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 150 00000100:00100000:1.0:1788837966.554245:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+34:11397:x1875732240339328:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:1.0:1788837966.554329:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6d74 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.554346:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6d74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.554358:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6d74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.554373:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6d7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.554400:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6d7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.554407:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6d7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.554517:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6d82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.554524:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6d82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.554530:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6d82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788837966.554817:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6d82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.554833:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6d74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.554840:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6d74 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.554846:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6d74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.554852:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3d000 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837966.554857:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6d74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.554864:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6d74 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.554886:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:1.0:1788837966.554889:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837966.554895:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6d74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.554901:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6d74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.554916:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6d7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.554924:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6d7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.554931:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6d7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.554936:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3c600 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837966.554939:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6d7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.554945:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6d7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.554952:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a45487ff00) 00010000:00010000:1.0:1788837966.554954:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837966.554957:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6d7b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.554962:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6d7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.554989:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6d82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.554996:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6d82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.555001:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6d82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.555007:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3c800 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837966.555010:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6d82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.555016:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6d82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.555024:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a45487f300) 00010000:00010000:1.0:1788837966.555027:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837966.555030:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6d82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837966.555036:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6d82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837966.555127:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+34:11397:x1875732240339328:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 883us (7550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837966.555136:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 150 00000100:00100000:3.0:1788837966.557715:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837966.557983:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240339584 00000100:00100000:1.0:1788837966.557994:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240339584 00000100:00100000:1.0:1788837966.558060:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:1.0:1788837966.558086:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+34:11397:x1875732240339584:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1788837966.558346:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+35:11397:x1875732240339584:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 264us (643us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1788837966.558354:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:3.0:1788837966.624196:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837966.624386:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240339840 00000100:00100000:2.0:1788837966.624398:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240339840 00000100:00100000:2.0:1788837966.624474:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 151 00000100:00100000:2.0:1788837966.624485:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+35:11401:x1875732240339840:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788837966.624512:0:10730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837966.624552:0:10730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e6d89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d20e expref: -99 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.624651:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6d90 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.624666:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6d90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.624678:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6d90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.624694:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6d97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.624701:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6d97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.624708:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6d97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.624834:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6d9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.624844:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.624850:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837966.624860:0:10730:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788837966.624964:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6d90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.624981:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6d90 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.624987:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6d90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.624993:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5e00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837966.624997:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6d90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.625004:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6d90 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.625017:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:2.0:1788837966.625021:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837966.625026:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6d90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.625032:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6d90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.625047:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6d97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.625053:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6d97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.625059:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6d97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.625064:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4400 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837966.625073:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6d97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.625079:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6d97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.625087:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a448b3cc00) 00010000:00010000:2.0:1788837966.625090:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837966.625093:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6d97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.625098:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6d97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.625141:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e6d89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d20e expref: 38 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.625171:0:10730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6d9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d20e expref: 37 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837966.625178:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a45487f300) 00010000:00010000:2.0:1788837966.625181:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837966.625183:0:10730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5c00, rc 0) 00000100:00100000:2.0:1788837966.625360:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+37:11401:x1875732240339840:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 876us (1176us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1788837966.625367:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 151 00000100:00100000:2.0:1788837966.639481:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837966.639716:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240339968 00000100:00100000:0.0:1788837966.639740:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240339968 00000100:00100000:0.0:1788837966.639810:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 152 00000100:00100000:0.0:1788837966.639822:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a477ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+37:11401:x1875732240339968:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:0.0:1788837966.639899:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e6dac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837966.639918:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e6dac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837966.639930:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e6dac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837966.639960:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e6dac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837966.639967:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e6dac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837966.639974:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e6dac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837966.639981:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e791400 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837966.639986:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e6dac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837966.639995:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e6dac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837966.640010:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a45487f300) 00010000:00010000:0.0:1788837966.640013:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788837966.640019:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e6dac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837966.640039:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e6dac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837966.640126:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a477ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+37:11401:x1875732240339968:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 306us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837966.640133:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 152 00000100:00100000:1.0:1788837966.656181:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837966.656371:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240340224 00000100:00100000:2.0:1788837966.656383:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240340224 00000100:00100000:2.0:1788837966.656452:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:2.0:1788837966.656479:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+37:11401:x1875732240340224:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788837966.656739:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+38:11401:x1875732240340224:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 261us (568us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788837966.656747:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:2.0:1788837967.094821:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837967.095848:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240340480 00000100:00100000:1.0:1788837967.095862:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240340480 00000100:00100000:1.0:1788837967.095953:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 153 00000100:00100000:1.0:1788837967.095969:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a477ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+38:11432:x1875732240340480:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:1.0:1788837967.095996:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837967.096016:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6db3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d215 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837967.096144:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6dba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837967.096159:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837967.096172:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837967.096183:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788837967.096354:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6db3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d215 expref: 41 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837967.096374:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6dba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d215 expref: 40 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837967.097037:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a45487f300) 00010000:00010000:1.0:1788837967.097041:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837967.097045:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3d000, rc 0) 00000100:00100000:1.0:1788837967.097618:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a477ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+40:11432:x1875732240340480:12345-192.168.204.54@tcp:101:cat.0 Request processed in 1228us (2379us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1788837967.097627:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 153 00000100:00080000:0.0:1788837967.099668:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837967.104097:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837967.104140:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837967.104604:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240340864 00000100:00100000:0.0:1788837967.104615:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240340864 00000100:00100000:0.0:1788837967.104686:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:0.0:1788837967.104695:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a477ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+40:11432:x1875732240340864:12345-192.168.204.54@tcp:35:cat.0 00000100:00100000:0.0:1788837967.104953:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a477ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+41:11432:x1875732240340864:12345-192.168.204.54@tcp:35:cat.0 Request processed in 258us (811us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788837967.104962:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:3.0:1788837967.106777:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240340608 00000100:00100000:3.0:1788837967.106792:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240340608 00000100:00100000:3.0:1788837967.106866:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:3.0:1788837967.106876:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a477ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+41:2349:x1875732240340608:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837967.106891:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837967.106917:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6dba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d215 expref: 41 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837967.106939:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a45487f300) 00010000:00010000:3.0:1788837967.106944:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837967.107012:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a477ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+40:2349:x1875732240340608:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 138us (2925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837967.107038:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:2.0:1788837967.288715:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837967.288965:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240341120 00000100:00100000:3.0:1788837967.288976:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240341120 00000100:00100000:3.0:1788837967.289056:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 154 00000100:00100000:3.0:1788837967.289068:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a477ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+40:11438:x1875732240341120:12345-192.168.204.54@tcp:101:dd.0 00010000:00010000:3.0:1788837967.289098:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837967.289101:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788837967.289129:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e6d20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1eb expref: 40 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837967.289151:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:3.0:1788837967.289157:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788837967.289171:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e6dc8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d21c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837967.289339:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6dcf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837967.289354:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6d9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d20e expref: 40 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837967.289364:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6dcf lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837967.289413:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6d9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d20e expref: 40 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837967.289426:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6d9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d20e expref: 40 pid: 10730 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837967.289454:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b662a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5809:1875732255024256:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788837967.289720:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a462ab10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837967.301160:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b662a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5809:1875732255024256:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788837967.301194:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6dcf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837967.308673:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837967.309071:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240341248 00000100:00100000:3.0:1788837967.309082:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240341248 00010000:00010000:3.0:1788837967.309123:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6d9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d20e expref: 41 pid: 10730 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837967.309171:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:3.0:1788837967.309181:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f36050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+41:2351:x1875732240341248:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837967.309227:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837967.309246:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6d9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d20e expref: 41 pid: 10730 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837967.309261:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6d9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d20e expref: 41 pid: 10730 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837967.309284:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6d9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d20e expref: 41 pid: 10730 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837967.309300:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a45487f300) 00010000:00010000:3.0:1788837967.309306:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6dcf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837967.309328:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6dcf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837967.309335:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6dcf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837967.309372:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837967.309446:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f36050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+40:2351:x1875732240341248:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 266us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837967.309454:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 64 00010000:00010000:2.0:1788837967.309744:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6dcf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.309752:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6dcf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837967.309772:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788837967.309930:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e6dc8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d21c expref: 41 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.309945:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6dcf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d21c expref: 40 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.309953:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a45487f300) 00010000:00010000:2.0:1788837967.309956:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788837967.309959:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48ba00, rc 0) 00000100:00100000:2.0:1788837967.309983:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a477ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+40:11438:x1875732240341120:12345-192.168.204.54@tcp:101:dd.0 Request processed in 20918us (21279us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788837967.309989:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 154 00000100:00100000:1.0:1788837967.321170:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837967.321469:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240341504 00000100:00100000:3.0:1788837967.321482:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240341504 00000100:00100000:3.0:1788837967.321545:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 155 00000100:00100000:3.0:1788837967.321555:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+40:11438:x1875732240341504:12345-192.168.204.54@tcp:36:dd.0 00010000:00010000:3.0:1788837967.321847:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e6ddd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837967.321866:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e6ddd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837967.321878:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e6ddd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788837967.321933:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1788837967.321956:0:5808:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad4573b4 reply state 0000000041d9449f transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e6ddd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837967.321965:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788837967.322070:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+43:11438:x1875732240341504:12345-192.168.204.54@tcp:36:dd.0 Request processed in 516us (911us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1788837967.322094:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 155 00000020:00080000:3.0:1788837967.322100:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788837967.329176:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e6ddd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837967.329256:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e6ddd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837967.329264:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e6ddd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837967.329271:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48a000 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837967.329276:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e6ddd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837967.329284:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e6ddd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837967.329304:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a45487f300) 00010000:00010000:3.0:1788837967.329307:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837967.329313:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e6ddd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837967.329318:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e6ddd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837967.394904:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837967.809997:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837967.811055:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240341632 00000100:00100000:2.0:1788837967.811070:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240341632 00000100:00100000:2.0:1788837967.811148:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 156 00000100:00100000:2.0:1788837967.811157:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+42:11452:x1875732240341632:12345-192.168.204.54@tcp:101:stat.0 00010000:00010000:2.0:1788837967.811181:0:10730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837967.811400:0:10730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6de4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d223 expref: -99 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.811471:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6deb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.811486:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6deb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.811496:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6deb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.811511:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6df2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.811517:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6df2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.811523:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6df2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.811672:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6df9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.811682:0:10730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6dcf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d21c expref: 43 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.811706:0:10730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6df9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.812766:0:10730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6dcf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d21c expref: 43 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.812790:0:10730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6dcf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d21c expref: 43 pid: 5809 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837967.812807:0:10730:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a477ec7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10730:1875732255024384:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788837967.812929:0:10730:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a345895b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788837967.820910:0:10730:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a477ec7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10730:1875732255024384:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788837967.820940:0:10730:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6df9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837967.823629:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837967.823744:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240341888 00000100:00100000:0.0:1788837967.823756:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240341888 00000100:00100000:0.0:1788837967.823818:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:0.0:1788837967.823827:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+44:5589:x1875732240341888:12345-192.168.204.54@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788837967.824174:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+45:5589:x1875732240341888:12345-192.168.204.54@tcp:35:ldlm_bl.0 Request processed in 347us (554us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1788837967.824182:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:0.0:1788837967.838924:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837967.841888:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240342016 00000100:00100000:3.0:1788837967.841903:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240342016 00010000:00010000:3.0:1788837967.841957:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6dcf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d21c expref: 45 pid: 5809 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837967.842026:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:3.0:1788837967.842036:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b0a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+45:2352:x1875732240342016:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837967.842063:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837967.842071:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6dcf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d21c expref: 45 pid: 5809 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837967.842085:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6dcf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d21c expref: 45 pid: 5809 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837967.842108:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6dcf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d21c expref: 45 pid: 5809 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837967.842127:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a45487f300) 00010000:00010000:3.0:1788837967.842143:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6df9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837967.842153:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837967.842161:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6df9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837967.842196:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837967.842566:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b0a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+44:2352:x1875732240342016:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 532us (3652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837967.842575:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 65 00010000:00010000:2.0:1788837967.843434:0:10730:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.843446:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837967.843496:0:10730:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788837967.843500:0:10730:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837967.843522:0:10730:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.843536:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.843564:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6deb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.843580:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6deb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.843587:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6deb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.843592:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5e00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837967.843596:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6deb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.843603:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6deb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.843616:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:2.0:1788837967.843619:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837967.843624:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6deb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.843630:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6deb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.843644:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6df2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.843649:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6df2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.843654:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6df2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.843666:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5c00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837967.843669:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6df2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.843675:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6df2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.843683:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a448b3cc00) 00010000:00010000:2.0:1788837967.843685:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837967.843688:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6df2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.843695:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6df2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.843747:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6de4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d223 expref: 44 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.843762:0:10730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6df9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d223 expref: 43 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837967.843769:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a45487f300) 00010000:00010000:2.0:1788837967.843771:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837967.843773:0:10730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4400, rc 0) 00000100:00100000:2.0:1788837967.843835:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+43:11452:x1875732240341632:12345-192.168.204.54@tcp:101:stat.0 Request processed in 32678us (33848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837967.843843:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 156 00000100:00100000:0.0:1788837968.027793:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837968.027947:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240342272 00000100:00100000:2.0:1788837968.027970:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240342272 00000100:00100000:2.0:1788837968.028032:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 157 00000100:00100000:2.0:1788837968.028044:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b0a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+43:11458:x1875732240342272:12345-192.168.204.54@tcp:36:truncate.0 00010000:00010000:2.0:1788837968.028105:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837968.028145:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6df9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d223 expref: 43 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837968.028166:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a45487f300) 00010000:00010000:2.0:1788837968.028172:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837968.028461:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6e00 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837968.028477:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6e00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837968.028488:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6e00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788837968.028537:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1788837968.028562:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000605d7d78 reply state 0000000047f10878 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6e00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837968.028961:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788837968.029082:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b0a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+45:11458:x1875732240342272:12345-192.168.204.54@tcp:36:truncate.0 Request processed in 1038us (1297us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788837968.029090:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 157 00000020:00080000:2.0:1788837968.029095:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788837968.034556:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a477ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732255024640:0@lo:400:kworker.0 00000100:00100000:2.0:1788837968.034639:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837968.034705:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f47ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255025152:0@lo:400:kworker.0 00000100:00100000:2.0:1788837968.034741:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837968.034774:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837968.034780:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f47dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732255024768:0@lo:400:kworker.0 00000100:00100000:2.0:1788837968.034802:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837968.034953:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a477ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3274:1875732255024512:0@lo:400:kworker.0 00000100:00100000:1.0:1788837968.034990:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837968.035021:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f47ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3274:1875732255025024:0@lo:400:kworker.0 00000100:00100000:1.0:1788837968.035043:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837968.035064:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837968.035070:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f47c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255024896:0@lo:400:kworker.0 00000100:00100000:1.0:1788837968.035092:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837968.035118:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255024640 00000100:00100000:1.0:1788837968.035125:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255024640 00000100:00100000:1.0:1788837968.035167:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255024768 00000100:00100000:1.0:1788837968.035171:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255024768 00000100:00100000:1.0:1788837968.035228:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255025024 00000100:00100000:1.0:1788837968.035231:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255025024 00000100:00100000:1.0:1788837968.035253:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788837968.035261:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f47ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732255024640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837968.035318:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f47ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732255024640:12345-0@lo:400:kworker.0 Request processed in 57us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837968.035332:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788837968.035350:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788837968.035356:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f47d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732255024768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837968.035398:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f47d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732255024768:12345-0@lo:400:kworker.0 Request processed in 42us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837968.035403:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788837968.035414:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788837968.035420:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1875732255025024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837968.035447:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1875732255025024:12345-0@lo:400:kworker.0 Request processed in 28us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837968.035452:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788837968.035484:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f47ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3274:1875732255025024:0@lo:400:kworker.0 00000100:00100000:1.0:1788837968.035513:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f47dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732255024768:0@lo:400:kworker.0 00000100:00100000:1.0:1788837968.035523:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a477ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732255024640:0@lo:400:kworker.0 00000004:00080000:3.0:1788837968.037106:0:7971:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 348130900206ns, next at 349130897875ns, rc = 0 00000100:00100000:3.0:1788837968.037294:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255025280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837968.037363:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837968.037436:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255025280 00000100:00100000:3.0:1788837968.037444:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255025280 00000100:00100000:3.0:1788837968.037492:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788837968.037501:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3272:x1875732255025280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788837968.037537:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788837968.037861:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3272:x1875732255025280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 361us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837968.037869:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788837968.037969:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255025280:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788837968.038054:0:3257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6e00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.038065:0:3257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6e00 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.038071:0:3257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6e00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.038078:0:3257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5800 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837968.038084:0:3257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6e00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.038091:0:3257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6e00 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.038108:0:3257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a45487f300) 00010000:00010000:3.0:1788837968.038111:0:3257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837968.038122:0:3257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6e00 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.038129:0:3257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e6e00 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837968.038239:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255024512 00000100:00100000:2.0:1788837968.038245:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255024512 00000100:00100000:2.0:1788837968.038278:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788837968.038286:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3274:x1875732255024512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837968.038329:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3274:x1875732255024512:12345-0@lo:400:kworker.0 Request processed in 44us (3338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837968.038335:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788837968.038369:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a477ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3274:1875732255024512:0@lo:400:kworker.0 00000100:00100000:2.0:1788837968.038403:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255025152 00000100:00100000:2.0:1788837968.038407:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255025152 00000100:00100000:2.0:1788837968.038428:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255024896 00000100:00100000:2.0:1788837968.038431:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255024896 00000100:00100000:2.0:1788837968.038451:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788837968.038457:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f47f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3271:x1875732255025152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837968.038489:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f47f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3271:x1875732255025152:12345-0@lo:400:kworker.0 Request processed in 33us (3748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837968.038496:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788837968.038505:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788837968.038510:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732255024896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837968.038535:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732255024896:12345-0@lo:400:kworker.0 Request processed in 25us (3442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837968.038549:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788837968.038585:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f47c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255024896:0@lo:400:kworker.0 00000100:00080000:0.0:1788837968.038744:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788837968.038749:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788837968.038752:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837968.042104:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f47ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255025152:0@lo:400:kworker.0 00000001:00080000:0.0:1788837968.143870:0:7611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:0.0:1788837968.143886:0:7611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:0.0:1788837968.288562:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837968.288668:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240342400 00000100:00100000:1.0:1788837968.288678:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240342400 00000100:00100000:1.0:1788837968.288752:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 158 00000100:00100000:1.0:1788837968.288763:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b0a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+44:11472:x1875732240342400:12345-192.168.204.54@tcp:101:stat.0 00010000:00010000:1.0:1788837968.288787:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837968.288809:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6e07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d22a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.288879:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6e0e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.288909:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6e0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.288919:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6e0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.288933:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6e15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.288940:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.288945:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.289031:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e6e1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.289039:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e6e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.289046:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e6e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837968.289078:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1788837968.289082:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788837968.289115:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e6e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.289329:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e6e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.289349:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6e0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.289355:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6e0e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.289362:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6e0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.289367:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3ce00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837968.289371:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6e0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.289390:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6e0e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.289403:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:1.0:1788837968.289406:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837968.289410:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6e0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.289416:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6e0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.289431:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.289437:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6e15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.289443:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6e15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.289454:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3d000 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837968.289458:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6e15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.289464:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6e15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.289472:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a45487fc00) 00010000:00010000:1.0:1788837968.289475:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837968.289478:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6e15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.289483:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6e15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.289517:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6e07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d22a expref: 46 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.289532:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e6e1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d22a expref: 45 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.289539:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a45487f300) 00010000:00010000:1.0:1788837968.289541:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837968.289543:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3d200, rc 0) 00000100:00100000:1.0:1788837968.289610:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b0a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+45:11472:x1875732240342400:12345-192.168.204.54@tcp:101:stat.0 Request processed in 849us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837968.289618:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 158 00010000:00010000:0.0:1788837968.418617:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837968.432315:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837968.433383:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240342656 00000100:00100000:1.0:1788837968.433420:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240342656 00000100:00100000:1.0:1788837968.433492:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 159 00000100:00100000:1.0:1788837968.433504:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+45:11482:x1875732240342656:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788837968.433524:0:10730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837968.433548:0:10730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6e23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d231 expref: -99 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837968.433918:0:10730:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788837968.436389:0:10730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6e23 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d231 expref: 47 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.436412:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a45487fa00) 00010000:00010000:1.0:1788837968.436415:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788837968.436420:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6e23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d231 expref: 47 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.436438:0:10730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3c400, rc 0) 00000100:00100000:1.0:1788837968.436525:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+46:11482:x1875732240342656:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 3023us (4220us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1788837968.436535:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 159 00000100:00100000:0.0:1788837968.452151:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837968.452415:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240342912 00000100:00100000:3.0:1788837968.452425:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240342912 00000100:00100000:3.0:1788837968.452487:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:3.0:1788837968.452497:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4713acc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+46:11482:x1875732240342912:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1788837968.452769:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4713acc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+47:11482:x1875732240342912:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 272us (637us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788837968.452776:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:0.0:1788837968.537759:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837968.537947:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240343168 00000100:00100000:2.0:1788837968.537956:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240343168 00000100:00100000:2.0:1788837968.538021:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 160 00000100:00100000:2.0:1788837968.538030:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b0a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+47:11488:x1875732240343168:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788837968.538054:0:7972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837968.538076:0:7972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6e31 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d238 expref: -99 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837968.538332:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6e38 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837968.538350:0:7972:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e6e1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d22a expref: 48 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837968.538359:0:7972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6e38 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837968.538407:0:7972:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e6e1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d22a expref: 48 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837968.538421:0:7972:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e6e1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d22a expref: 48 pid: 5810 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837968.538434:0:7972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f47c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7972:1875732255025408:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788837968.538580:0:7972:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a345895780 going to sleep for 11 seconds 00000100:00100000:2.0:1788837968.549273:0:7972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f47c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7972:1875732255025408:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788837968.549306:0:7972:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6e38 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837968.555696:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837968.555838:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240343296 00000100:00100000:3.0:1788837968.555848:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240343296 00010000:00010000:3.0:1788837968.555891:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e6e1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d22a expref: 49 pid: 5810 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837968.555934:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:3.0:1788837968.555944:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b0a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+49:2351:x1875732240343296:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837968.555959:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837968.555966:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e6e1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d22a expref: 49 pid: 5810 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.555979:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e6e1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d22a expref: 49 pid: 5810 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.556019:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e6e1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d22a expref: 49 pid: 5810 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.556036:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a45487f300) 00010000:00010000:3.0:1788837968.556042:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6e38 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.556050:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6e38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.556058:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6e38 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.556102:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837968.556164:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b0a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+48:2351:x1875732240343296:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 222us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837968.556172:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 66 00010000:00010000:2.0:1788837968.556855:0:7972:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6e38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837968.556866:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6e38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837968.556886:0:7972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1788837968.557041:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e6e31 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d238 expref: 49 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837968.557058:0:7972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6e38 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d238 expref: 48 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837968.557067:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a45487f300) 00010000:00010000:2.0:1788837968.557070:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788837968.557073:0:7972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5c00, rc 0) 00000100:00100000:2.0:1788837968.557133:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b0a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+48:11488:x1875732240343168:12345-192.168.204.54@tcp:101:bash.0 Request processed in 19104us (19383us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1788837968.557151:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 160 00000100:00100000:0.0:1788837968.559734:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837968.559881:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240343552 00000100:00100000:2.0:1788837968.559892:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240343552 00000100:00100000:2.0:1788837968.559953:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 161 00000100:00100000:2.0:1788837968.559963:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b0a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+48:11488:x1875732240343552:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:2.0:1788837968.560291:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6e46 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837968.560325:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6e46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837968.560337:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6e46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788837968.560405:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1788837968.560429:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008782665c reply state 00000000e629c4c1 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6e46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837968.560438:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788837968.560520:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b0a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+51:11488:x1875732240343552:12345-192.168.204.54@tcp:36:bash.0 Request processed in 558us (795us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788837968.560528:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 161 00000020:00080000:2.0:1788837968.560532:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788837968.564858:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6e46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.564876:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6e46 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.564884:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6e46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.564891:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5e00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837968.564896:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6e46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.564922:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6e46 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.564939:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a45487f300) 00010000:00010000:3.0:1788837968.564942:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837968.564948:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6e46 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.564954:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e6e46 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837968.569034:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837968.569129:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240343680 00000100:00100000:3.0:1788837968.569138:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240343680 00000100:00100000:3.0:1788837968.569199:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 162 00000100:00100000:3.0:1788837968.569246:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b0a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+50:11488:x1875732240343680:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1788837968.569272:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837968.569294:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e6e4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d23f expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.569390:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6e54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.569405:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6e38 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d238 expref: 51 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.569414:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6e54 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.569446:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6e38 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d238 expref: 51 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.569473:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6e38 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d238 expref: 51 pid: 7972 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837968.569487:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b661500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5808:1875732255025536:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788837968.569594:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a46e685540 going to sleep for 11 seconds 00000100:00100000:1.0:1788837968.573847:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b661500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5808:1875732255025536:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788837968.573876:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6e54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837968.575054:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837968.575431:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240343808 00000100:00100000:2.0:1788837968.575439:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240343808 00010000:00010000:2.0:1788837968.575477:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6e38 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d238 expref: 52 pid: 7972 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837968.575515:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:2.0:1788837968.575524:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b0a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+52:2351:x1875732240343808:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837968.575538:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837968.575544:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6e38 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d238 expref: 52 pid: 7972 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837968.575609:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6e38 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d238 expref: 52 pid: 7972 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837968.575993:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6e38 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d238 expref: 52 pid: 7972 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837968.576010:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a45487f300) 00010000:00010000:2.0:1788837968.576016:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6e54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837968.576025:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6e54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837968.576034:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6e54 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837968.576957:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837968.577021:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b0a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+51:2351:x1875732240343808:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 1494us (1969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837968.577031:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 67 00010000:00010000:1.0:1788837968.581709:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6e54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.581729:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6e54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837968.581807:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788837968.581812:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788837968.581835:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6e54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.581878:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e6e4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d23f expref: 51 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.581899:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6e54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d23f expref: 50 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.581907:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a45487f300) 00010000:00010000:1.0:1788837968.581910:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837968.581914:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48ba00, rc 0) 00000100:00100000:1.0:1788837968.582004:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b0a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+50:11488:x1875732240343680:12345-192.168.204.54@tcp:101:bash.0 Request processed in 12760us (12979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837968.582014:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 162 00000100:00100000:0.0:1788837968.587517:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837968.587645:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240344064 00000100:00100000:3.0:1788837968.587733:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240344064 00000100:00100000:3.0:1788837968.587800:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:3.0:1788837968.587810:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b0a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+50:11488:x1875732240344064:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:3.0:1788837968.588064:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b0a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+51:11488:x1875732240344064:12345-192.168.204.54@tcp:35:bash.0 Request processed in 254us (555us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1788837968.588071:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:0.0:1788837968.679967:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837968.680094:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240344320 00000100:00100000:2.0:1788837968.680104:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240344320 00000100:00100000:2.0:1788837968.680259:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 163 00000100:00100000:2.0:1788837968.680269:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b0a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+51:11498:x1875732240344320:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788837968.680293:0:7972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837968.680312:0:7972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6e5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d246 expref: -99 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837968.680431:0:7972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788837968.680555:0:7972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6e5b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d246 expref: 53 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837968.680583:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a45487fa00) 00010000:00010000:2.0:1788837968.680586:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788837968.680605:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6e5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d246 expref: 53 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837968.680620:0:7972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5c00, rc 0) 00000100:00100000:2.0:1788837968.680674:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b0a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+52:11498:x1875732240344320:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 407us (715us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1788837968.680680:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 163 00000100:00100000:0.0:1788837968.689119:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837968.689711:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240344448 00000100:00100000:1.0:1788837968.689727:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240344448 00000100:00100000:1.0:1788837968.689818:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 164 00000100:00100000:1.0:1788837968.689830:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b0a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+52:11498:x1875732240344448:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:1.0:1788837968.689940:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6e69 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.689963:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6e69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.689978:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6e69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.690030:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6e70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.690039:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6e70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.690045:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6e70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.690164:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6e77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.690945:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6e77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.690957:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6e77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788837968.691035:0:10730:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6e77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.691051:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6e69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.691059:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6e69 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.691067:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6e69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.691073:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3c400 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837968.691078:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6e69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.691101:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6e69 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.691117:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:1.0:1788837968.691120:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837968.691126:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6e69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.691132:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6e69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.691149:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6e70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.691156:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6e70 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.691162:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6e70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.691167:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3d000 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837968.691941:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6e70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.691952:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6e70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.691964:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a45487fc00) 00010000:00010000:1.0:1788837968.691967:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837968.691971:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6e70 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.691992:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6e70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.692016:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6e77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.692023:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6e77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.692029:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6e77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.692035:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3ce00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837968.692038:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6e77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.692045:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6e77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.692054:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a45487f300) 00010000:00010000:1.0:1788837968.692057:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837968.692059:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6e77 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.692065:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6e77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837968.692198:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b0a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+52:11498:x1875732240344448:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 2364us (3088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837968.692235:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 164 00000100:00100000:0.0:1788837968.698389:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837968.698488:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240344704 00000100:00100000:3.0:1788837968.698499:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240344704 00000100:00100000:3.0:1788837968.698574:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:3.0:1788837968.698585:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b0a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+52:11498:x1875732240344704:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1788837968.698881:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b0a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+53:11498:x1875732240344704:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 298us (515us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788837968.698888:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:0.0:1788837968.759335:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837968.759513:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240344960 00000100:00100000:1.0:1788837968.759526:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240344960 00000100:00100000:1.0:1788837968.759673:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 165 00000100:00100000:1.0:1788837968.759685:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+53:11501:x1875732240344960:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788837968.759711:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837968.759731:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6e7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d24d expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.759809:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6e85 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.759824:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6e85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.759835:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6e85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.759848:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6e8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.759857:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6e8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.759862:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6e8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.760001:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6e93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.760022:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6e93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.760046:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6e93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837968.760057:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788837968.760154:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6e85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.760162:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6e85 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.760170:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6e85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.760176:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3d000 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837968.760180:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6e85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.760187:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6e85 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.760199:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:1.0:1788837968.760253:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837968.760258:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6e85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.760264:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6e85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.760278:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6e8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.760284:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6e8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.760296:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6e8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.760300:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3c400 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837968.760303:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6e8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.760309:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6e8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.760317:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a45487fc00) 00010000:00010000:1.0:1788837968.760319:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837968.760323:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6e8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.760328:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6e8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.760384:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6e7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d24d expref: 56 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.760400:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6e93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d24d expref: 55 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.760408:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a45487f300) 00010000:00010000:1.0:1788837968.760409:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837968.760412:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3c600, rc 0) 00000100:00100000:1.0:1788837968.760471:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+55:11501:x1875732240344960:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 788us (1146us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1788837968.760486:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 165 00000100:00100000:0.0:1788837968.766487:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837968.768133:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240345216 00000100:00100000:3.0:1788837968.768153:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240345216 00000100:00100000:0.0:1788837968.769055:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:0.0:1788837968.769073:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+55:2351:x1875732240345216:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837968.769107:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837968.769143:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6e93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d24d expref: 55 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837968.769172:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a45487f300) 00010000:00010000:0.0:1788837968.769177:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837968.769309:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+54:2351:x1875732240345216:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 240us (2834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837968.769317:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:2.0:1788837968.770123:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837968.770249:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240345088 00000100:00100000:3.0:1788837968.770259:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240345088 00000100:00100000:3.0:1788837968.770325:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 166 00000100:00100000:3.0:1788837968.770335:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f47c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+54:11501:x1875732240345088:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:3.0:1788837968.770444:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6ea1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.770462:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.770473:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.770498:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.770505:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6ea1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.770511:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6ea1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.770518:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48ac00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837968.770522:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6ea1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.770530:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6ea1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.770540:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a45487f300) 00010000:00010000:3.0:1788837968.770544:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788837968.770549:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6ea1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837968.770555:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6ea1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837968.770661:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f47c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+54:11501:x1875732240345088:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 327us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837968.770670:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 166 00000100:00100000:3.0:1788837968.776969:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837968.777803:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240345472 00000100:00100000:0.0:1788837968.777817:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240345472 00000100:00100000:0.0:1788837968.777912:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:0.0:1788837968.777924:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+54:11501:x1875732240345472:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:0.0:1788837968.778480:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+55:11501:x1875732240345472:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 556us (1952us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1788837968.778491:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:3.0:1788837968.964493:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837968.964767:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240345728 00000100:00100000:1.0:1788837968.964791:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240345728 00000100:00100000:1.0:1788837968.964889:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 167 00000100:00100000:1.0:1788837968.964902:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+55:11519:x1875732240345728:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:1.0:1788837968.964935:0:10730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837968.964963:0:10730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6ea8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d254 expref: -99 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.965097:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6eaf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.965119:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6eaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.965241:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6eaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837968.965259:0:10730:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788837968.965444:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6ea8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d254 expref: 58 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.965469:0:10730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6eaf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d254 expref: 57 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837968.965479:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a45487f300) 00010000:00010000:1.0:1788837968.965483:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788837968.965487:0:10730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3c400, rc 0) 00000100:00100000:1.0:1788837968.967481:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+57:11519:x1875732240345728:12345-192.168.204.54@tcp:101:cat.0 Request processed in 2564us (2985us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788837968.967499:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 167 00000100:00100000:3.0:1788837969.008796:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837969.009108:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240345856 00000100:00100000:1.0:1788837969.009121:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240345856 00000100:00100000:1.0:1788837969.009477:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 168 00000100:00100000:1.0:1788837969.009491:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+57:11520:x1875732240345856:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788837969.009526:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837969.009555:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6ebd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d25b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837969.009659:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6ec4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837969.009679:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837969.009693:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837969.009754:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788837969.009768:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788837969.009800:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837969.009836:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6ebd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d25b expref: 59 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837969.009859:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d25b expref: 58 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837969.009896:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:1.0:1788837969.009899:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788837969.009903:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3d000, rc 0) 00000100:00080000:0.0:1788837969.010081:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837969.010177:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+58:11520:x1875732240345856:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 688us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837969.010188:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 168 00000100:00100000:0.0:1788837969.018805:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837969.019421:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240346240 00000100:00100000:3.0:1788837969.019436:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240346240 00000100:00100000:3.0:1788837969.019516:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:3.0:1788837969.019528:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+58:11520:x1875732240346240:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1788837969.020042:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+59:11520:x1875732240346240:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 514us (1248us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788837969.020052:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:2.0:1788837969.024649:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837969.024872:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240346368 00000100:00100000:3.0:1788837969.024888:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240346368 00000100:00100000:3.0:1788837969.024977:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:3.0:1788837969.024989:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f47c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+59:11520:x1875732240346368:12345-192.168.204.54@tcp:103:lfs.0 00010000:00010000:3.0:1788837969.025010:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788837969.025042:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6e54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d23f expref: 59 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.025082:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e6eaf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d254 expref: 58 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.025098:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e6d5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d200 expref: 57 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.025128:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a45487f300) 00010000:00010000:3.0:1788837969.025143:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837969.026547:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f47c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+56:11520:x1875732240346368:12345-192.168.204.54@tcp:103:lfs.0 Request processed in 1546us (1899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837969.026562:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:0.0:1788837969.039631:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837969.040670:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240346496 00000100:00100000:2.0:1788837969.040688:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240346496 00000100:00100000:2.0:1788837969.040789:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 169 00000100:00100000:2.0:1788837969.040801:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+56:11520:x1875732240346496:12345-192.168.204.54@tcp:58:lfs.0 00010000:00010000:2.0:1788837969.040955:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e6ecb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.040987:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e6ecb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.041001:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e6ecb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788837969.041305:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788837969.041445:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+56:11520:x1875732240346496:12345-192.168.204.54@tcp:58:lfs.0 Request processed in 644us (1827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837969.041475:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 169 00000100:00100000:1.0:1788837969.067341:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837969.069871:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240346624 00000100:00100000:2.0:1788837969.069893:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240346624 00000100:00100000:2.0:1788837969.070002:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 170 00000100:00100000:2.0:1788837969.070015:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a477ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+56:11522:x1875732240346624:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788837969.070043:0:10730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837969.070071:0:10730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6ed2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d262 expref: -99 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.070166:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6ed9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.070187:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6ed9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.070200:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6ed9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.070448:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6ee0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.070457:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.070464:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.070797:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6ee7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.070831:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.070839:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837969.070889:0:10730:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788837969.070894:0:10730:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837969.070918:0:10730:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.070933:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.070942:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6ed9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.070948:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6ed9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.070956:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6ed9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.070963:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837969.070968:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6ed9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.070976:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6ed9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.070991:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:2.0:1788837969.071001:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837969.071006:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6ed9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.071014:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6ed9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.071032:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.071037:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6ee0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.071043:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6ee0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.071049:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4c00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837969.071052:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6ee0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.071058:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6ee0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.071066:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a448b3c000) 00010000:00010000:2.0:1788837969.071069:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837969.071072:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6ee0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.071078:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6ee0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.071118:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6ed2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d262 expref: 58 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.071149:0:10730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6ee7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d262 expref: 57 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.071158:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a448b3cc00) 00010000:00010000:2.0:1788837969.071160:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788837969.071163:0:10730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5600, rc 0) 00000100:00100000:2.0:1788837969.071955:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a477ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+57:11522:x1875732240346624:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1936us (4624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837969.071969:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 170 00000100:00100000:3.0:1788837969.095801:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837969.095924:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837969.095973:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837969.096889:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837969.097340:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240346880 00000100:00100000:2.0:1788837969.097356:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240346880 00000100:00100000:2.0:1788837969.097468:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240347008 00000100:00100000:2.0:1788837969.097472:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240347008 00000100:00100000:2.0:1788837969.097503:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 76 00000100:00100000:2.0:1788837969.097515:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2350:x1875732240346880:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788837969.097623:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2350:x1875732240346880:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 110us (1838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837969.097632:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 76 00000100:00100000:2.0:1788837969.097652:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:2.0:1788837969.097660:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a458c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2350:x1875732240347008:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788837969.097688:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a458c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2350:x1875732240347008:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 29us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837969.097695:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:1.0:1788837969.100756:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240347136 00000100:00100000:1.0:1788837969.100780:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240347136 00000100:00100000:1.0:1788837969.100891:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 164 00000100:00100000:1.0:1788837969.100904:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2350:x1875732240347136:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788837969.101027:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2350:x1875732240347136:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 126us (5102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837969.101036:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 164 00000100:00080000:3.0:1788837969.101980:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788837969.101991:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788837969.101995:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837969.103024:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240346752 00000100:00100000:0.0:1788837969.103041:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240346752 00000100:00100000:0.0:1788837969.103124:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 301 00000100:00100000:0.0:1788837969.103136:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2350:x1875732240346752:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788837969.103257:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2350:x1875732240346752:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 123us (7282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837969.103265:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 301 00000040:00080000:3.0:1788837969.386553:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788837969.386563:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788837969.386622:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788837969.386629:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788837969.386767:0:11659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875732255025664:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788837969.386866:0:11659:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a46e685300 going to sleep for 11 seconds 00000100:00100000:3.0:1788837969.392807:0:11659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875732255025664:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788837969.395477:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837969.395570:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240347264 00000100:00100000:1.0:1788837969.395581:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240347264 00000100:00100000:1.0:1788837969.395650:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 171 00000100:00100000:1.0:1788837969.395663:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+57:11533:x1875732240347264:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788837969.395702:0:5809:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788837969.395840:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+57:11533:x1875732240347264:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 181us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837969.395849:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 171 00000100:00100000:1.0:1788837969.401493:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837969.401562:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240347392 00000100:00100000:3.0:1788837969.401573:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240347392 00000100:00100000:3.0:1788837969.401629:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 172 00000100:00100000:3.0:1788837969.401639:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a477ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+57:11533:x1875732240347392:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788837969.401714:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6eee lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.401741:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6eee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.401753:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6eee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.401769:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48aa00/0x2deb895b363e6ef5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.401777:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48aa00/0x2deb895b363e6ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.401783:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48aa00/0x2deb895b363e6ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.401809:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6efc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.401817:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6efc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.401824:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6efc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837969.401861:0:10730:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788837969.401865:0:10730:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788837969.401878:0:10730:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6efc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.401888:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6eee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.401904:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6eee lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.401911:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6eee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.401917:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48ba00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837969.401922:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6eee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.401929:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6eee lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.401942:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a448b3cf00) 00010000:00010000:3.0:1788837969.401946:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837969.401951:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6eee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.401956:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6eee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.401969:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48aa00/0x2deb895b363e6ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.401976:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48aa00/0x2deb895b363e6ef5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.401982:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48aa00/0x2deb895b363e6ef5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.401986:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48aa00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837969.401997:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48aa00/0x2deb895b363e6ef5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.402004:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48aa00/0x2deb895b363e6ef5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.402012:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff97a460c5e700) 00010000:00010000:3.0:1788837969.402015:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837969.402017:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48aa00/0x2deb895b363e6ef5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.402023:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48aa00/0x2deb895b363e6ef5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.402037:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6efc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.402043:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6efc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.402049:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6efc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.402053:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48ac00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837969.402056:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6efc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.402062:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6efc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.402069:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a448b3cc00) 00010000:00010000:3.0:1788837969.402071:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837969.402079:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6efc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.402100:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6efc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837969.402456:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a477ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+57:11533:x1875732240347392:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 Request processed in 814us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837969.402464:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 172 00000100:00100000:3.0:1788837969.407523:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837969.407802:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240347648 00000100:00100000:0.0:1788837969.407813:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240347648 00000100:00100000:0.0:1788837969.407878:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 173 00000100:00100000:0.0:1788837969.407888:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+57:11533:x1875732240347648:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788837969.407908:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837969.407930:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e6f03 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d269 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.408041:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e6f0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.408070:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e6f0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.408082:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e6f0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837969.408118:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788837969.408472:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e6f0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.408481:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e6f0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.408488:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e6f0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.408494:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e791600 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837969.408498:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e6f0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.408505:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e6f0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.408518:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a448b3cc00) 00010000:00010000:0.0:1788837969.408521:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788837969.408526:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e6f0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.408531:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e6f0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.408571:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e6f03 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d269 expref: 59 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.408590:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a448b3cf00) 00010000:00010000:0.0:1788837969.408592:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788837969.408596:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e6f03 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d269 expref: 59 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.408607:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e790000, rc 0) 00000100:00100000:0.0:1788837969.408780:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+58:11533:x1875732240347648:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 893us (1267us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1788837969.408787:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 173 00000100:00100000:0.0:1788837969.419181:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837969.419338:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240347776 00000100:00100000:3.0:1788837969.419348:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240347776 00000100:00100000:3.0:1788837969.419420:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 174 00000100:00100000:3.0:1788837969.419431:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+58:11533:x1875732240347776:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788837969.419469:0:7972:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788837969.419590:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+58:11533:x1875732240347776:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 159us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837969.419597:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 174 00000100:00100000:3.0:1788837969.424130:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837969.424321:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240348032 00000100:00100000:2.0:1788837969.424344:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240348032 00000100:00100000:2.0:1788837969.424416:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 175 00000100:00100000:2.0:1788837969.424426:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+58:11533:x1875732240348032:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837969.424448:0:10730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837969.424451:0:10730:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788837969.424479:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e6ec4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d25b expref: 58 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.424501:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:2.0:1788837969.424506:0:10730:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837969.424520:0:10730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6f18 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d270 expref: -99 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788837969.424959:0:10730:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788837969.426911:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e6f1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.426932:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e6f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.426945:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e6f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.427014:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e6f18 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d270 expref: 60 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.427034:0:10730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e6f1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d270 expref: 59 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.427043:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97a462b58b00) 00010000:00010000:0.0:1788837969.427046:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837969.427062:0:10730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e790000, rc 0) 00000100:00100000:0.0:1788837969.427151:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+59:11533:x1875732240348032:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 2725us (3029us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1788837969.427160:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 175 00000100:00100000:2.0:1788837969.433655:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837969.433733:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240348288 00000100:00100000:0.0:1788837969.433744:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240348288 00000100:00100000:0.0:1788837969.433808:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 176 00000100:00100000:0.0:1788837969.433819:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f47e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+59:11533:x1875732240348288:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788837969.433877:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837969.433906:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e6f1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d270 expref: 59 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.433926:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97a462b58b00) 00010000:00010000:0.0:1788837969.433936:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837969.433962:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6f2d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.433976:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6f2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.433985:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6f2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.434045:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6f34 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xcb20434f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.434054:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6f34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xcb20434f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.434060:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6f34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xcb20434f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.434377:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6f2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.434385:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6f2d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.434392:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6f2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.434399:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e790800 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837969.434403:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6f2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.434411:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6f2d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.434419:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:0.0:1788837969.434423:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837969.434426:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6f2d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.434431:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e6f2d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.434440:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6f34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xcb20434f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.434445:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6f34 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xcb20434f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.434452:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6f34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xcb20434f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.434464:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e790200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837969.434467:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6f34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xcb20434f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.434474:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6f34 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xcb20434f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.434482:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xcb20434f (ffff97a462b58200) 00010000:00010000:0.0:1788837969.434485:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837969.434487:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6f34 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xcb20434f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.434493:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6f34 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xcb20434f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837969.434595:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f47e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+58:11533:x1875732240348288:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 777us (950us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788837969.434602:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 176 00000100:00100000:3.0:1788837969.438949:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837969.439035:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240348416 00000100:00100000:1.0:1788837969.439052:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240348416 00000100:00100000:1.0:1788837969.439121:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 177 00000100:00100000:1.0:1788837969.439131:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+58:11533:x1875732240348416:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788837969.439158:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837969.439182:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6f3b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d277 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837969.439250:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6f42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837969.439265:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6f42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837969.439277:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6f42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837969.439383:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6f3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d277 expref: 60 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837969.439401:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6f42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d277 expref: 59 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837969.439411:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97a45487fc00) 00010000:00010000:1.0:1788837969.439414:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788837969.439417:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3ce00, rc 0) 00000100:00100000:1.0:1788837969.439484:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+59:11533:x1875732240348416:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 353us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837969.439491:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 177 00010000:00010000:3.0:1788837969.443052:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837969.452192:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837969.453401:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240348672 00000100:00100000:0.0:1788837969.453416:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240348672 00000100:00100000:0.0:1788837969.453521:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 178 00000100:00100000:0.0:1788837969.453532:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f47f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+59:11533:x1875732240348672:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788837969.453619:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6f49 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.453639:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6f49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.453651:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6f49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788837969.453943:0:10730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1788837969.453954:0:10730:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 349547751251ns, next at 350547748083ns, rc = 0 00000004:00010000:0.0:1788837969.454058:0:10730:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9b36035 reply state 00000000a1040033 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6f49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837969.454068:0:10730:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788837969.454186:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f47f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+61:11533:x1875732240348672:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 654us (2001us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1788837969.454194:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 178 00010000:00010000:3.0:1788837969.458990:0:3257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6f49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.459015:0:3257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6f49 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.459025:0:3257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6f49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.459058:0:3257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e790200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837969.459064:0:3257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6f49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.459075:0:3257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6f49 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.459101:0:3257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97a45487fc00) 00010000:00010000:3.0:1788837969.459105:0:3257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788837969.459126:0:3257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6f49 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.459135:0:3257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e6f49 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837969.462961:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837969.463048:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240348800 00000100:00100000:3.0:1788837969.463066:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240348800 00000100:00100000:3.0:1788837969.463167:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 179 00000100:00100000:3.0:1788837969.463180:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f47ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+60:11533:x1875732240348800:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788837969.463263:0:7972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837969.463295:0:7972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6f50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d27e expref: -99 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.463396:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6f50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d27e expref: 61 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.463414:0:7972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6f50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d27e expref: 61 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.463469:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97a45487fc00) 00010000:00010000:3.0:1788837969.463473:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788837969.463478:0:7972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48b200, rc 0) 00000100:00100000:3.0:1788837969.464339:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f47ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+61:11533:x1875732240348800:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1155us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837969.464349:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 179 00000100:00100000:0.0:1788837969.482182:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837969.483028:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240348928 00000100:00100000:2.0:1788837969.483044:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240348928 00000100:00100000:2.0:1788837969.483117:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:2.0:1788837969.483128:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2349:x1875732240348928:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788837969.483519:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2349:x1875732240348928:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 390us (1350us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788837969.483527:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:0.0:1788837969.487081:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837969.487410:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240349184 00000100:00100000:1.0:1788837969.487437:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240349184 00000100:00100000:1.0:1788837969.487520:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:1.0:1788837969.487533:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+61:11533:x1875732240349184:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788837969.487783:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+62:11533:x1875732240349184:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 254us (717us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1788837969.487790:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:3.0:1788837969.490545:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837969.492666:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240349440 00000100:00100000:1.0:1788837969.492682:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240349440 00000100:00100000:1.0:1788837969.492823:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 180 00000100:00100000:1.0:1788837969.492838:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+62:11533:x1875732240349440:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788837969.493265:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+62:11533:x1875732240349440:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 431us (2727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837969.493274:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 180 00000100:00100000:1.0:1788837969.499683:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837969.499825:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240349568 00000100:00100000:0.0:1788837969.499845:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240349568 00000100:00100000:0.0:1788837969.499938:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 181 00000100:00100000:0.0:1788837969.499951:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a477ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+62:11533:x1875732240349568:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788837969.499980:0:10730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837969.500011:0:10730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e6f57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d285 expref: -99 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.500106:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e6f5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.500123:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e6f5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.500138:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e6f5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837969.500197:0:10730:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788837969.500254:0:10730:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e6f5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.500287:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e6f57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d285 expref: 64 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.500307:0:10730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e6f5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d285 expref: 63 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.500317:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97a45487fc00) 00010000:00010000:0.0:1788837969.500320:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788837969.500325:0:10730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e791400, rc 0) 00000100:00100000:0.0:1788837969.500430:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a477ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+63:11533:x1875732240349568:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 480us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837969.500438:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 181 00000100:00100000:3.0:1788837969.503771:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837969.503874:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240349696 00000100:00100000:0.0:1788837969.503885:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240349696 00000100:00100000:0.0:1788837969.503958:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:0.0:1788837969.503972:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2352:x1875732240349696:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788837969.503991:0:6652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837969.504015:0:6652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9267447/0x2deb895b363e6f65 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d28c expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788837969.504046:0:6652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f8050, blocks: 0x1 00010000:00010000:0.0:1788837969.504068:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=349s v=(0 0) 00010000:00010000:0.0:1788837969.504087:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837969.504098:0:6652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9267447/0x2deb895b363e6f65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d28c expref: 8 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.504131:0:6652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e9267447/0x2deb895b363e6f65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d28c expref: 8 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.504155:0:6652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e790800, rc 0) 00000100:00100000:0.0:1788837969.504258:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:2352:x1875732240349696:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 290us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837969.504265:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:3.0:1788837969.514091:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837969.514229:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240349952 00000100:00100000:0.0:1788837969.514239:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240349952 00000100:00100000:0.0:1788837969.514318:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 182 00000100:00100000:0.0:1788837969.514330:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+63:11533:x1875732240349952:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788837969.514470:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+63:11533:x1875732240349952:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 142us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837969.514479:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 182 00000100:00100000:0.0:1788837969.520799:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837969.521315:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240350080 00000100:00100000:3.0:1788837969.521327:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240350080 00000100:00100000:3.0:1788837969.521404:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:3.0:1788837969.521416:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:11533:x1875732240350080:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788837969.521436:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837969.521455:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e6f6c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d293 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.521486:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9267447/0x2deb895b363e6f65 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d28c expref: 9 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.521494:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837969.521498:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837969.521504:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e6f6c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d293 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.521565:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e9267447/0x2deb895b363e6f65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d28c expref: 9 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.521581:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e9267447/0x2deb895b363e6f65 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d28c expref: 9 pid: 6652 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837969.521597:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448f90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6682:1875732255025792:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788837969.521716:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a46e685300 going to sleep for 11 seconds 00000100:00100000:2.0:1788837969.528791:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448f90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6682:1875732255025792:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788837969.528843:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e6f6c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d293 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.528891:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48ac00, rc 0) 00000100:00100000:2.0:1788837969.528997:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+9:11533:x1875732240350080:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 7582us (8205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837969.529009:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:2.0:1788837969.545783:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837969.545866:0:7599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240350208 00000100:00100000:1.0:1788837969.545884:0:7599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240350208 00010000:00010000:1.0:1788837969.545945:0:7599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e9267447/0x2deb895b363e6f65 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d28c expref: 9 pid: 6652 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837969.546000:0:7599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:1.0:1788837969.546012:0:7599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f47d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+9:2352:x1875732240350208:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837969.546033:0:7599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837969.546068:0:7599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e9267447/0x2deb895b363e6f65 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d28c expref: 9 pid: 6652 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837969.546103:0:7599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e9267447/0x2deb895b363e6f65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d28c expref: 9 pid: 6652 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837969.546133:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9267447/0x2deb895b363e6f65 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d28c expref: 9 pid: 6652 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837969.546155:0:7599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837969.546160:0:7599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837969.546172:0:7599:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e6f6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d293 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837969.546184:0:7599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e6f6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d293 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837969.546270:0:7599:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e6f6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d293 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837969.546294:0:7599:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a477ec7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7599:1875732255025920:192.168.204.54@tcp:105: 00000100:00100000:1.0:1788837969.546411:0:7599:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a46e8eb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837969.549914:0:7599:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a477ec7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7599:1875732255025920:192.168.204.54@tcp:105: 00010000:00010000:1.0:1788837969.549953:0:7599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837969.550010:0:7599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f47d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:2352:x1875732240350208:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 3999us (4242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837969.550021:0:7599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:1.0:1788837969.560891:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837969.561446:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240350336 00000100:00100000:0.0:1788837969.561461:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240350336 00002000:00100000:0.0:1788837969.561549:0:6657:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff97a477ec7480 x1875732240350336/t0(0) o4->f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7@192.168.204.54@tcp:625/0 lens 504/0 e 0 to 0 dl 1788837980 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788837969.561568:0:6657:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a477ec7480 with x1875732240350336 ext(0->8) 00002000:00010000:0.0:1788837969.561575:0:6657:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97a477ec7480 00000100:00100000:0.0:1788837969.561612:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:0.0:1788837969.561644:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a477ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:2351:x1875732240350336:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788837969.562261:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a477ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+10:2351:x1875732240350336:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 Request processed in 615us (1382us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788837969.562270:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00002000:00100000:0.0:1788837969.562280:0:6657:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff97a477ec7480 x1875732240350336/t4294967314(0) o4->f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7@192.168.204.54@tcp:625/0 lens 504/448 e 0 to 0 dl 1788837980 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788837969.562290:0:6657:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a477ec7480 with x1875732240350336 ext(0->8) 00002000:00010000:0.0:1788837969.562295:0:6657:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97a477ec7480 00000100:00100000:3.0:1788837969.565887:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837969.566708:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240350464 00000100:00100000:0.0:1788837969.566725:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240350464 00000100:00100000:0.0:1788837969.566801:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 183 00000100:00100000:0.0:1788837969.566813:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+63:11533:x1875732240350464:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788837969.679168:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:3.0:1788837969.679190:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:3.0:1788837969.679252:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1788837969.679273:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788837969.679297:0:5830:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97a46e8ebc00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788837969.679303:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a450a3a000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97a46e8ebd80 00000020:00080000:3.0:1788837969.679307:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a450a3a800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97a46f030000 00000004:00080000:3.0:1788837969.679393:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:0.0:1788837969.679913:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+18:11533:x1875732240350464:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 Request processed in 113092us (114026us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837969.679926:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 183 00000020:00080000:0.0:1788837969.680181:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1788837969.680452:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788837969.681873:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f47e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255026048:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788837969.682533:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837969.683397:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255026048 00000100:00100000:1.0:1788837969.683412:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255026048 00000100:00100000:1.0:1788837969.683492:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788837969.683504:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f47c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255026048:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788837969.683764:0:6652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788837969.683768:0:6652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788837968 00002000:00010000:1.0:1788837969.683771:0:6652:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788837969.683773:0:6652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788837968 -> 1788837968 00002000:00010000:1.0:1788837969.683776:0:6652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788837969.683860:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f47c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3273:x1875732255026048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 359us (1329us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788837969.683868:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000004:00080000:2.0:1788837969.684224:0:3273:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97a46f47e300/2, rc 0, transno 4294967315 00000100:00100000:2.0:1788837969.684232:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f47e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255026048:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788837969.686071:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255026176:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788837969.686159:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837969.686541:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837969.686651:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255026176 00000100:00100000:2.0:1788837969.686662:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255026176 00000100:00100000:2.0:1788837969.686720:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240350592 00000100:00100000:2.0:1788837969.686723:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240350592 00000100:00100000:2.0:1788837969.686751:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788837969.686761:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732255026176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788837969.686798:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1788837969.686845:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f804d, atime: 0x6a9f804d, ctime: 0x6a9f804d, blocks: 0xb 00010000:00010000:2.0:1788837969.686854:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd9387b3/0x2deb895b363e6f73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.686876:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=349s v=(0 0) 00010000:00010000:2.0:1788837969.686882:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837969.686890:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd9387b3/0x2deb895b363e6f73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.686924:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd9387b3/0x2deb895b363e6f73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.686936:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd9387b3/0x2deb895b363e6f73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.686944:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd9387b3/0x2deb895b363e6f73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.686964:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788837969.687789:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:3.0:1788837969.687805:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+10:2350:x1875732240350592:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788837969.689721:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3274:x1875732255026176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2948us (3549us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788837969.689740:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:2.0:1788837969.689792:0:7598:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837969.689801:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd9387b3/0x2deb895b363e6f73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.689816:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4e00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:2.0:1788837969.689823:0:7598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd9387b3/0x2deb895b363e6f73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.689836:0:7598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd9387b3/0x2deb895b363e6f73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.689862:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd9387b3/0x2deb895b363e6f73 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.689888:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd9387b3/0x2deb895b363e6f73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.689915:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837969.689917:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837969.689919:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837969.691817:0:3274:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1788837969.691829:0:3274:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1788837969.691868:0:3274:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff97a46f4b8380 x1875732255026176/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788837985 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788837969.691884:0:3274:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97a46f4b8380/2, rc 0, transno 4294967307 00000100:00100000:0.0:1788837969.691903:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255026176:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788837969.828375:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+10:2350:x1875732240350592:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 Request processed in 140548us (141814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837969.828393:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 55 00000001:00080000:0.0:1788837969.828508:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:0.0:1788837969.828529:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1788837969.832104:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837969.832285:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240350848 00000100:00100000:1.0:1788837969.832299:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240350848 00000100:00100000:1.0:1788837969.832395:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 184 00000100:00100000:1.0:1788837969.832409:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+18:11533:x1875732240350848:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788837969.833236:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837969.833279:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e6f5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d285 expref: 18 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837969.833300:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97a45487fc00) 00010000:00010000:1.0:1788837969.833306:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788837969.833359:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6f7a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837969.833390:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6f7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837969.833402:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6f7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788837969.834576:0:5808:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001df93442 reply state 0000000068ec9c02 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6f7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837969.834610:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788837969.834892:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+19:11533:x1875732240350848:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 2482us (2798us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788837969.834901:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 184 00010000:00010000:3.0:1788837969.839847:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6f7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.839874:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6f7a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.839882:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6f7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.839890:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3c600 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837969.839896:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6f7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.839905:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6f7a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.839928:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97a45487fc00) 00010000:00010000:3.0:1788837969.839932:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837969.839939:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6f7a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.839945:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6f7a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837969.843560:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837969.843692:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240350976 00000100:00100000:1.0:1788837969.843706:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240350976 00000100:00100000:1.0:1788837969.843789:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:1.0:1788837969.843813:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f47df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2351:x1875732240350976:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788837969.844155:0:6650:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788837969.844159:0:6650:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788837968 -> 1788837967 00002000:00010000:1.0:1788837969.844162:0:6650:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788837965 00002000:00010000:1.0:1788837969.844164:0:6650:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788837968 -> 1788837967 00002000:00010000:1.0:1788837969.844166:0:6650:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788837969.844296:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f47df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:2351:x1875732240350976:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 486us (752us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788837969.844305:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:2.0:1788837969.850358:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837969.850413:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240351232 00000100:00100000:0.0:1788837969.850435:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240351232 00000100:00100000:0.0:1788837969.850520:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 185 00000100:00100000:0.0:1788837969.850534:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f47f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+18:11533:x1875732240351232:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788837969.850778:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6f81 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.851509:0:7972:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6f42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d277 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.851524:0:7972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6f81 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.851867:0:7972:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6f42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d277 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.851890:0:7972:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6f42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d277 expref: 18 pid: 5808 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837969.851909:0:7972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a45108f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7972:1875732255026304:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788837969.852067:0:7972:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f9fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837969.855728:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837969.855812:0:7972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a45108f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7972:1875732255026304:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788837969.855854:0:7972:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6f81 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837969.856097:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240351360 00000100:00100000:3.0:1788837969.856107:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240351360 00010000:00010000:3.0:1788837969.856178:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6f42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d277 expref: 19 pid: 5808 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837969.856370:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:3.0:1788837969.856383:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f37450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+19:2352:x1875732240351360:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837969.856632:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837969.856644:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6f42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d277 expref: 19 pid: 5808 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.856675:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6f42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d277 expref: 19 pid: 5808 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.856706:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e6f42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d277 expref: 19 pid: 5808 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.856728:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97a45487fc00) 00010000:00010000:0.0:1788837969.856734:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6f81 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.856746:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6f81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.856755:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6f81 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.856788:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837969.856867:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f37450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+18:2352:x1875732240351360:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 486us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837969.856875:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 69 00010000:00010000:2.0:1788837969.857045:0:7972:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6f81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.857053:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6f81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.857095:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6f81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.857103:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6f81 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.857110:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6f81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.857117:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e791000 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837969.857122:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6f81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.857139:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6f81 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.857150:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97a45487fc00) 00010000:00010000:2.0:1788837969.857153:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788837969.857157:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6f81 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.857164:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e6f81 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837969.857268:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f47f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+17:11533:x1875732240351232:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 Request processed in 6738us (6936us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788837969.857278:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 185 00000100:00100000:2.0:1788837969.863629:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837969.864266:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240351488 00000100:00100000:0.0:1788837969.864279:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240351488 00000100:00100000:0.0:1788837969.864369:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:0.0:1788837969.864381:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f47d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:2349:x1875732240351488:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788837969.864445:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000ad185a4/0x2deb895b363e6f88 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.864495:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e6f6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d293 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.864505:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837969.864511:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788837969.864517:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ad185a4/0x2deb895b363e6f88 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.864580:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e6f6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d293 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.864606:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e6f6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d293 expref: 8 pid: 6682 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837969.864622:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a45108f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6682:1875732255026432:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788837969.864747:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f9f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788837969.875751:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a45108f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6682:1875732255026432:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788837969.875802:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000ad185a4/0x2deb895b363e6f88 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837969.881844:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837969.882011:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240351616 00000100:00100000:0.0:1788837969.882026:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240351616 00010000:00010000:0.0:1788837969.882078:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e6f6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d293 expref: 9 pid: 6682 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837969.882186:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:0.0:1788837969.882230:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f47fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+9:2352:x1875732240351616:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837969.882250:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837969.882282:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e6f6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d293 expref: 9 pid: 6682 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.882311:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e6f6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d293 expref: 9 pid: 6682 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.882355:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e6f6c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d293 expref: 9 pid: 6682 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.882378:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788837969.882383:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788837969.882390:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000ad185a4/0x2deb895b363e6f88 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.882403:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ad185a4/0x2deb895b363e6f88 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837969.882459:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837969.882542:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f47fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:2352:x1875732240351616:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 315us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837969.882551:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 70 00010000:00010000:2.0:1788837969.882772:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000ad185a4/0x2deb895b363e6f88 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.882784:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ad185a4/0x2deb895b363e6f88 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.882814:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000ad185a4/0x2deb895b363e6f88 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.882822:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ad185a4/0x2deb895b363e6f88 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.882842:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ad185a4/0x2deb895b363e6f88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.882849:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e791400 already unused, calling callback (ffffffffc1616420) 00010000:00010000:2.0:1788837969.882854:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ad185a4/0x2deb895b363e6f88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.882863:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ad185a4/0x2deb895b363e6f88 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.882876:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ad185a4/0x2deb895b363e6f88 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.882884:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ad185a4/0x2deb895b363e6f88 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837969.882948:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f47d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2349:x1875732240351488:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 Request processed in 18569us (19335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837969.882957:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:0.0:1788837969.888511:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837969.888825:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240351872 00000100:00100000:2.0:1788837969.888838:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240351872 00000100:00100000:2.0:1788837969.889574:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 186 00000100:00100000:2.0:1788837969.889592:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+17:11533:x1875732240351872:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788837969.889713:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6f8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.889753:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6f8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.889768:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6f8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.890049:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6f96 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.890063:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6f50 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d27e expref: 18 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.890072:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6f96 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.890118:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6f50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d27e expref: 18 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.890135:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6f50 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d27e expref: 18 pid: 7972 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837969.891729:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f47c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5809:1875732255026560:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788837969.891864:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4618bb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837969.901739:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837969.901879:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f47c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5809:1875732255026560:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788837969.901918:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6f96 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837969.901938:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240352000 00000100:00100000:3.0:1788837969.901947:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240352000 00010000:00010000:3.0:1788837969.901996:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6f50 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d27e expref: 19 pid: 7972 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837969.902042:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:3.0:1788837969.902383:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f47d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+19:2351:x1875732240352000:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837969.902404:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837969.902412:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6f50 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d27e expref: 19 pid: 7972 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.902427:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6f50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d27e expref: 19 pid: 7972 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.902456:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6f50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d27e expref: 19 pid: 7972 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.902471:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97a45487fc00) 00010000:00010000:3.0:1788837969.902477:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6f96 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.902489:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6f96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.902504:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6f96 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.902647:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837969.902731:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f47d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+18:2351:x1875732240352000:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 678us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837969.902738:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 71 00010000:00010000:2.0:1788837969.903313:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6f96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.903324:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6f96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788837969.903671:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1788837969.903861:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1788837969.903910:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1788837969.904020:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f47ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5809:1875732255026688:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788837969.904103:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837969.904198:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a45517a840 going to sleep for 11 seconds 00000100:00100000:3.0:1788837969.905717:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255026688 00000100:00100000:3.0:1788837969.905733:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255026688 00000100:00100000:0.0:1788837969.905988:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788837969.906002:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f47dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5809:x1875732255026688:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788837969.906194:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f47dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5809:x1875732255026688:12345-0@lo:1000:mdt00_001.0 Request processed in 184us (2080us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837969.906227:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788837969.906323:0:5809:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1788837969.906331:0:5809:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97a46f47e300, transno 4294967315 00000100:00100000:2.0:1788837969.906360:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f47ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5809:1875732255026688:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788837969.906994:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1788837969.907106:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f47ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5809:1875732255026816:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788837969.907167:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837969.908847:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4618bb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837969.909691:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255026816 00000100:00100000:3.0:1788837969.909704:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255026816 00000100:00100000:3.0:1788837969.909774:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788837969.909785:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f47ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5809:x1875732255026816:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788837969.913872:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f47ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5809:x1875732255026816:12345-0@lo:1000:mdt00_001.0 Request processed in 4066us (6681us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788837969.913898:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788837969.914901:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f47ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5809:1875732255026816:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788837969.915299:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6f96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.915313:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6f96 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.915322:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6f96 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.915329:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4c00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837969.915335:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6f96 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.915355:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6f96 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.915389:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97a45487fc00) 00010000:00010000:2.0:1788837969.915393:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788837969.915399:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6f96 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.915405:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6f96 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.915448:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e6ecb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.915456:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e6ecb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.915462:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e6ecb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.915468:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5400 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837969.915471:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e6ecb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.915477:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e6ecb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.915485:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a448b3cc00) 00010000:00010000:2.0:1788837969.915487:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788837969.915490:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e6ecb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.915496:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e6ecb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.915531:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6f9d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.915619:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6ee7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d262 expref: 21 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.915630:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6f9d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.915681:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6ee7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d262 expref: 21 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.915699:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6ee7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d262 expref: 21 pid: 10730 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837969.915715:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f47e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5809:1875732255026944:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788837969.915881:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4601b2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788837969.921575:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837969.921758:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f47e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5809:1875732255026944:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788837969.921801:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6f9d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837969.922863:0:7599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240352128 00000100:00100000:1.0:1788837969.922877:0:7599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240352128 00010000:00010000:1.0:1788837969.922941:0:7599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6ee7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d262 expref: 22 pid: 10730 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837969.923005:0:7599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:1.0:1788837969.923017:0:7599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+22:2352:x1875732240352128:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837969.923037:0:7599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837969.923045:0:7599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6ee7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d262 expref: 22 pid: 10730 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837969.923059:0:7599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6ee7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d262 expref: 22 pid: 10730 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837969.923090:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e6ee7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d262 expref: 22 pid: 10730 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837969.923112:0:7599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a448b3cc00) 00010000:00010000:1.0:1788837969.923574:0:7599:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6f9d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837969.923590:0:7599:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6f9d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837969.923762:0:7599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6f9d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837969.923812:0:7599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837969.923910:0:7599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+21:2352:x1875732240352128:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 894us (2345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837969.923920:0:7599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 72 00010000:00010000:3.0:1788837969.924066:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6f9d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.924076:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6f9d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.924091:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6f9d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.924099:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6f9d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.924115:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6f9d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.924121:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4a00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837969.924126:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6f9d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.924135:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6f9d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.924147:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a448b3cc00) 00010000:00010000:3.0:1788837969.924151:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837969.924155:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6f9d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.924161:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4a00/0x2deb895b363e6f9d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.924175:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6f8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.924182:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6f8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.924199:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6f8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.924239:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5a00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837969.924242:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6f8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.924259:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6f8f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.924267:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a448b3cc00) 00010000:00010000:3.0:1788837969.924270:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788837969.924273:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6f8f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.924279:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e6f8f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837969.925365:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+20:11533:x1875732240351872:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 35760us (36849us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1788837969.925380:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 186 00000020:00080000:3.0:1788837969.925387:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788837969.925662:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788837969.925668:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788837969.926284:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1788837969.926296:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788837969.935554:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837969.936705:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240352384 00000100:00100000:3.0:1788837969.936724:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240352384 00000100:00100000:3.0:1788837969.936799:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:3.0:1788837969.936811:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4713ab850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+20:11533:x1875732240352384:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788837969.940956:0:5811:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788837969.941114:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1788837969.941240:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6fa4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.941263:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.941278:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.941301:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6fa4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.941308:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6fa4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.941315:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6fa4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.941342:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837969.941412:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837969.941423:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6fa4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837969.941430:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48ba00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:1.0:1788837969.941435:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6fa4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837969.941443:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6fa4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837969.941458:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97a460c5e500) 00010000:00010000:1.0:1788837969.941461:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788837969.941466:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6fa4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837969.941472:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6fa4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837969.941491:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837969.941493:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837969.941495:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837969.941501:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4713ab850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+22:11533:x1875732240352384:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 4686us (5968us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1788837969.941512:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 50 00000020:00080000:3.0:1788837969.941519:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1788837970.148677:0:12436:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788837970.148691:0:12436:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788837970.148737:0:12436:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788837970.148745:0:12436:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788837970.310152:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837970.310897:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240352640 00000100:00100000:1.0:1788837970.310908:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240352640 00000100:00100000:1.0:1788837970.311009:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 187 00000100:00100000:1.0:1788837970.311021:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+22:11544:x1875732240352640:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788837970.311045:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837970.311067:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6fab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d29a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.311189:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e6fb2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.311381:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e6fb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.311393:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e6fb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837970.311408:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788837970.311544:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e6fab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d29a expref: 25 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.311560:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e6fb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d29a expref: 24 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.311568:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:1.0:1788837970.311571:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788837970.311575:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3c000, rc 0) 00000100:00100000:1.0:1788837970.311764:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+24:11544:x1875732240352640:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 733us (1622us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1788837970.311771:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 187 00000100:00100000:1.0:1788837970.322891:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837970.325403:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240352768 00000100:00100000:2.0:1788837970.325419:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240352768 00000100:00100000:2.0:1788837970.325520:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 188 00000100:00100000:2.0:1788837970.325539:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+24:11544:x1875732240352768:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:2.0:1788837970.325628:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e6fc0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.325645:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e6fc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.325655:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e6fc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.325670:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6fc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.325677:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.325684:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.327709:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6fce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.327728:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6fce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.327739:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6fce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837970.327924:0:7972:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6fce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.327939:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e6fc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.327953:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e6fc0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.327960:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e6fc0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.327966:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5400 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837970.327971:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e6fc0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.327978:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e6fc0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.327991:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:2.0:1788837970.327994:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837970.327998:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e6fc0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.328004:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e6fc0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.328017:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.328023:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6fc7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.328029:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6fc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.328034:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4c00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837970.328042:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6fc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.328047:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6fc7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.328054:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a448b3c000) 00010000:00010000:2.0:1788837970.328056:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837970.328058:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6fc7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.328063:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4c00/0x2deb895b363e6fc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.328077:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6fce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.328082:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6fce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.328087:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6fce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.328091:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5c00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837970.328094:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6fce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.328100:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6fce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.328106:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a448b3c500) 00010000:00010000:2.0:1788837970.328108:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837970.328115:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6fce lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.328121:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e6fce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837970.328287:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+24:11544:x1875732240352768:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 2746us (5399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837970.328297:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 188 00000100:00100000:0.0:1788837970.414683:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837970.414811:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240353024 00000100:00100000:3.0:1788837970.414823:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240353024 00000100:00100000:3.0:1788837970.414927:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 189 00000100:00100000:3.0:1788837970.414939:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+24:11547:x1875732240353024:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788837970.414962:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837970.414983:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48aa00/0x2deb895b363e6fd5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d2a1 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.415067:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6fdc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.415082:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6fdc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.415113:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6fdc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.415129:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6fe3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.415136:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.415143:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.415429:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6fea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.415437:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6fea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.415443:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6fea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837970.415453:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788837970.415557:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6fdc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.415568:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6fdc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.415575:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6fdc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.415581:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48b200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837970.415591:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6fdc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.415598:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6fdc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.415610:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:3.0:1788837970.415613:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837970.415617:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6fdc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.415622:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e6fdc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.415632:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.415639:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6fe3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.415644:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6fe3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.415649:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48ba00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837970.415652:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6fe3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.415657:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6fe3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.415663:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a460c5e700) 00010000:00010000:3.0:1788837970.415665:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837970.415674:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6fe3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.415680:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e6fe3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.417586:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48aa00/0x2deb895b363e6fd5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2a1 expref: 27 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.417613:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6fea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2a1 expref: 26 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.417623:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a460c5e800) 00010000:00010000:2.0:1788837970.417626:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837970.417629:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48ac00, rc 0) 00000100:00100000:2.0:1788837970.417712:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+26:11547:x1875732240353024:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 2773us (3036us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1788837970.417721:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 189 00000100:00100000:3.0:1788837970.420488:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837970.425798:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240353152 00000100:00100000:0.0:1788837970.425815:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240353152 00000100:00100000:1.0:1788837970.426092:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 190 00000100:00100000:1.0:1788837970.426103:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+26:11547:x1875732240353152:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:1.0:1788837970.426175:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6ff8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.426191:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.426263:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.426294:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.426300:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6ff8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.426306:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6ff8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.426311:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3c800 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837970.426327:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6ff8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.426343:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6ff8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.426357:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a460c5e800) 00010000:00010000:1.0:1788837970.426360:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788837970.426364:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6ff8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.426370:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e6ff8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837970.426460:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+26:11547:x1875732240353152:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 358us (5986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837970.426477:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 190 00000100:00100000:1.0:1788837970.429831:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837970.429913:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240353408 00000100:00100000:2.0:1788837970.429925:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240353408 00000100:00100000:2.0:1788837970.429988:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:2.0:1788837970.429998:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+26:11547:x1875732240353408:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788837970.430274:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+27:11547:x1875732240353408:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 275us (451us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788837970.430283:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 51 00010000:00010000:0.0:1788837970.468778:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837970.469332:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837970.469405:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240353664 00000100:00100000:0.0:1788837970.469420:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240353664 00000100:00100000:0.0:1788837970.469493:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 191 00000100:00100000:0.0:1788837970.469503:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f47e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+27:11080:x1875732240353664:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1788837970.469539:0:7972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837970.469565:0:7972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6fff lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d2a8 expref: -99 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.469702:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e7006 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.469717:0:7972:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6fea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2a1 expref: 28 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.469725:0:7972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e7006 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.469760:0:7972:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6fea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2a1 expref: 28 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.469787:0:7972:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6fea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2a1 expref: 28 pid: 5809 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837970.469803:0:7972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a45108e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7972:1875732255027072:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788837970.469912:0:7972:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f9f300 going to sleep for 11 seconds 00000100:00100000:2.0:1788837970.472903:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837970.473030:0:7972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a45108e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7972:1875732255027072:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788837970.473068:0:7972:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e7006 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837970.475309:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240353792 00000100:00100000:3.0:1788837970.475324:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240353792 00010000:00010000:3.0:1788837970.475387:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6fea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2a1 expref: 29 pid: 5809 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837970.475483:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:3.0:1788837970.475494:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f47c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+29:2352:x1875732240353792:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837970.475509:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837970.475524:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6fea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2a1 expref: 29 pid: 5809 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.475537:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6fea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2a1 expref: 29 pid: 5809 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.475562:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e6fea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2a1 expref: 29 pid: 5809 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.475579:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a460c5e800) 00010000:00010000:3.0:1788837970.475584:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e7006 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.475593:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e7006 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.475615:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e7006 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.475650:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837970.475805:0:7972:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e7006 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.475814:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e7006 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837970.475837:0:7972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788837970.476017:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e6fff lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2a8 expref: 30 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.476033:0:7972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e7006 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2a8 expref: 29 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.476041:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a460c5e800) 00010000:00010000:2.0:1788837970.476044:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788837970.476046:0:7972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e790800, rc 0) 00000100:00100000:2.0:1788837970.476113:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f47e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+29:11080:x1875732240353664:12345-192.168.204.54@tcp:101:bash.0 Request processed in 6612us (6788us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1788837970.476121:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 191 00000100:00100000:3.0:1788837970.477108:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f47c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+28:2352:x1875732240353792:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 1610us (4210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837970.477120:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:2.0:1788837970.484854:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837970.485017:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240354048 00000100:00100000:1.0:1788837970.485028:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240354048 00000100:00100000:1.0:1788837970.485083:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 192 00000100:00100000:1.0:1788837970.485092:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+28:11080:x1875732240354048:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:1.0:1788837970.485823:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e7014 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.485843:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e7014 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.485854:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e7014 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788837970.485920:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1788837970.485952:0:5808:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a9b5a59 reply state 00000000ca8cf319 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e7014 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837970.485961:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788837970.486012:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1788837970.486728:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+32:11080:x1875732240354048:12345-192.168.204.54@tcp:36:bash.0 Request processed in 1631us (1880us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1788837970.486737:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 192 00000020:00080000:1.0:1788837970.486743:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788837970.501077:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837970.501173:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240354176 00000100:00100000:0.0:1788837970.501182:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240354176 00000100:00100000:0.0:1788837970.501267:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 193 00000100:00100000:0.0:1788837970.501276:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b09a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+32:11080:x1875732240354176:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1788837970.501302:0:10730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837970.501326:0:10730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e701b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d2af expref: -99 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.501407:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e701b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2af expref: 33 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.501421:0:10730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e701b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2af expref: 33 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.501438:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a460c5e800) 00010000:00010000:0.0:1788837970.501441:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788837970.501456:0:10730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e790000, rc 0) 00000100:00100000:0.0:1788837970.501519:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b09a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+33:11080:x1875732240354176:12345-192.168.204.54@tcp:101:bash.0 Request processed in 244us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837970.501527:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 193 00010000:00010000:3.0:1788837970.502750:0:3257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e7014 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.502764:0:3257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e7014 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.502771:0:3257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e7014 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.502778:0:3257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3de00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837970.502783:0:3257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e7014 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.502791:0:3257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e7014 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.502810:0:3257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a460c5e800) 00010000:00010000:3.0:1788837970.502815:0:3257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837970.502819:0:3257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e7014 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.502825:0:3257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3de00/0x2deb895b363e7014 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837970.515019:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837970.515127:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240354304 00000100:00100000:3.0:1788837970.517248:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240354304 00000100:00100000:3.0:1788837970.517429:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:3.0:1788837970.517441:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:11080:x1875732240354304:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1788837970.517461:0:6653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837970.517483:0:6653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e7022 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d2b6 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788837970.517512:0:6653:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f804f, atime: 0x6a9f804d, ctime: 0x6a9f804f, blocks: 0xb 00010000:00010000:3.0:1788837970.517548:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=350s v=(0 0) 00010000:00010000:3.0:1788837970.517554:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837970.517564:0:6653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e7022 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2b6 expref: 8 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.517583:0:6653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e7022 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2b6 expref: 8 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.517597:0:6653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48ac00, rc 0) 00000100:00100000:2.0:1788837970.517947:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:11080:x1875732240354304:12345-192.168.204.54@tcp:101:bash.0 Request processed in 506us (2934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837970.517954:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:0.0:1788837970.524144:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837970.524767:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240354432 00000100:00100000:1.0:1788837970.524778:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240354432 00002000:00010000:1.0:1788837970.524826:0:6658:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1788837970.524831:0:6658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a45108e680 with x1875732240354432 ext(0->18446744073709551615) 00002000:00010000:1.0:1788837970.524843:0:6658:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97a45108e680. 00000100:00100000:1.0:1788837970.524879:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:1.0:1788837970.524903:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:2351:x1875732240354432:12345-192.168.204.54@tcp:10:bash.0 00002000:00010000:1.0:1788837970.525193:0:6658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788837970.525197:0:6658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788837967 -> 1788837969 00002000:00010000:1.0:1788837970.525348:0:6658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788837965 -> 1788837965 00002000:00010000:1.0:1788837970.525353:0:6658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788837967 -> 1788837969 00002000:00010000:1.0:1788837970.525355:0:6658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788837970.525429:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+9:2351:x1875732240354432:12345-192.168.204.54@tcp:10:bash.0 Request processed in 527us (1294us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788837970.525438:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00002000:00010000:1.0:1788837970.525442:0:6658:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1788837970.525444:0:6658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a45108e680 with x1875732240354432 ext(0->18446744073709551615) 00002000:00010000:1.0:1788837970.525450:0:6658:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97a45108e680. 00000100:00100000:3.0:1788837970.629364:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837970.629988:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240354560 00000100:00100000:2.0:1788837970.629998:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240354560 00000100:00100000:2.0:1788837970.630084:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 194 00000100:00100000:2.0:1788837970.630096:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+32:11561:x1875732240354560:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:2.0:1788837970.630189:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e7029 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.630251:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e7029 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.630264:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e7029 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.630281:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7030 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.630290:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.630297:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.630867:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e7037 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.630879:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e7037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.630887:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e7037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837970.630929:0:7972:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e7037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.630941:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e7029 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.630955:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e7029 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.630962:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e7029 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.630968:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5e00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837970.630973:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e7029 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.630981:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e7029 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.630994:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:2.0:1788837970.630998:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837970.631003:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e7029 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.631009:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e7029 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.631023:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.631030:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7030 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.631036:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7030 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.631042:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4400 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837970.631051:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7030 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.631057:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7030 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.631066:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a448b3c500) 00010000:00010000:2.0:1788837970.631069:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837970.631072:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7030 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.631078:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7030 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.631094:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e7037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.631100:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e7037 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.631106:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e7037 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.631111:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5800 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837970.631113:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e7037 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.631119:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e7037 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.631126:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a460c5e800) 00010000:00010000:2.0:1788837970.631128:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837970.631137:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e7037 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.631142:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e7037 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837970.631272:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+32:11561:x1875732240354560:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 1174us (1915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837970.631281:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 194 00000100:00100000:2.0:1788837970.698087:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837970.699018:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240354816 00000100:00100000:1.0:1788837970.699030:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240354816 00000100:00100000:1.0:1788837970.699167:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 195 00000100:00100000:1.0:1788837970.699180:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+32:11564:x1875732240354816:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788837970.699215:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837970.699248:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e703e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d2bd expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.699320:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e7045 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.699349:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e7045 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.699361:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e7045 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.699392:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e704c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.699400:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e704c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.699407:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e704c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.699926:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e7053 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.699938:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e7053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.699947:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e7053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837970.699957:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788837970.700057:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e7045 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.700065:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e7045 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.700072:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e7045 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.700079:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3d000 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837970.700084:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e7045 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.700103:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e7045 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.700116:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:1.0:1788837970.700119:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837970.700124:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e7045 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.700130:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e7045 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.700145:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e704c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.700151:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e704c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.700157:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e704c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.700162:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3c600 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837970.700166:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e704c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.700173:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e704c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.700180:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a45487f500) 00010000:00010000:1.0:1788837970.700182:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837970.700185:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e704c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.700199:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e704c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.700458:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e703e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2bd expref: 35 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.700475:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e7053 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2bd expref: 34 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.700483:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a460c5e800) 00010000:00010000:1.0:1788837970.700496:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788837970.700499:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3ce00, rc 0) 00000100:00100000:1.0:1788837970.700604:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+34:11564:x1875732240354816:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1425us (2526us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1788837970.700613:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 195 00000100:00100000:0.0:1788837970.708153:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837970.708393:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240354944 00000100:00100000:2.0:1788837970.708404:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240354944 00000100:00100000:2.0:1788837970.708468:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 196 00000100:00100000:2.0:1788837970.708478:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+34:11564:x1875732240354944:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:2.0:1788837970.708564:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e7061 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.708583:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e7006 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2a8 expref: 34 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.708592:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e7061 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.708626:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e7006 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2a8 expref: 34 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.708641:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e7006 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2a8 expref: 34 pid: 7972 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837970.708655:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b09b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5809:1875732255027200:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788837970.712081:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4601b2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788837970.718084:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b09b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5809:1875732255027200:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788837970.718117:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e7061 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837970.723057:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837970.723363:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240355200 00000100:00100000:2.0:1788837970.723372:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240355200 00000100:00100000:2.0:1788837970.723433:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:2.0:1788837970.723442:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+35:5588:x1875732240355200:12345-192.168.204.54@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788837970.723815:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+36:5588:x1875732240355200:12345-192.168.204.54@tcp:35:ldlm_bl.0 Request processed in 372us (766us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1788837970.723823:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:3.0:1788837970.730422:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837970.730696:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240355328 00000100:00100000:0.0:1788837970.730706:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240355328 00010000:00010000:0.0:1788837970.730759:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e7006 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2a8 expref: 36 pid: 7972 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837970.730801:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 74 00000100:00100000:0.0:1788837970.730810:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b660e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+36:2352:x1875732240355328:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837970.730825:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837970.730832:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e7006 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2a8 expref: 36 pid: 7972 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.730847:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e7006 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2a8 expref: 36 pid: 7972 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.730870:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e7006 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2a8 expref: 36 pid: 7972 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.730887:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a460c5e800) 00010000:00010000:0.0:1788837970.730893:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e7061 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.730923:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e7061 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.730931:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e7061 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.730964:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837970.731023:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b660e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+35:2352:x1875732240355328:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 213us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837970.731031:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 74 00010000:00010000:2.0:1788837970.732096:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e7061 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.732108:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e7061 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.732142:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e7061 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.732149:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e7061 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.732156:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e7061 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.732162:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5800 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837970.732166:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e7061 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.732184:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e7061 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.732196:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a460c5e800) 00010000:00010000:2.0:1788837970.732199:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788837970.732237:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e7061 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.732244:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e7061 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837970.732316:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+34:11564:x1875732240354944:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 23838us (24169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837970.732325:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 196 00000100:00100000:3.0:1788837970.735318:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837970.735613:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240355584 00000100:00100000:2.0:1788837970.735625:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240355584 00000100:00100000:2.0:1788837970.735685:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:2.0:1788837970.735695:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+34:11564:x1875732240355584:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788837970.736132:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+35:11564:x1875732240355584:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 436us (824us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1788837970.736139:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:1.0:1788837970.868952:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837970.869077:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240355840 00000100:00100000:2.0:1788837970.869089:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240355840 00000100:00100000:2.0:1788837970.869170:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 197 00000100:00100000:2.0:1788837970.869183:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+35:11575:x1875732240355840:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:2.0:1788837970.869259:0:7972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837970.869287:0:7972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e7068 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d2c4 expref: -99 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.869625:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e706f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.869642:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e706f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.869652:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e706f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.869669:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e7076 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.869676:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e7076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.869683:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e7076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.869966:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e707d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.869976:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e707d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.869983:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e707d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837970.869994:0:7972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788837970.870092:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e706f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.870100:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e706f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.873154:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e706f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.873162:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4400 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837970.873167:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e706f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.873178:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e706f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.873203:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:2.0:1788837970.873207:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837970.873229:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e706f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.873237:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e706f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.873262:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e7076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.873270:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e7076 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.873275:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e7076 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.873280:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5e00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837970.873283:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e7076 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.873320:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e7076 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.873341:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a448b3c500) 00010000:00010000:2.0:1788837970.873343:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837970.873347:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e7076 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.873352:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e7076 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.873443:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e7068 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2c4 expref: 38 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.873461:0:7972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e707d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2c4 expref: 37 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.873469:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a460c5e800) 00010000:00010000:2.0:1788837970.873471:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837970.875623:0:7972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4000, rc 0) 00000100:00100000:2.0:1788837970.875731:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+37:11575:x1875732240355840:12345-192.168.204.54@tcp:101:cat.0 Request processed in 6547us (6785us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1788837970.875740:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 197 00000100:00100000:0.0:1788837970.886640:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837970.886790:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240356096 00000100:00100000:2.0:1788837970.886801:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240356096 00000100:00100000:2.0:1788837970.886866:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:2.0:1788837970.886882:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+37:11575:x1875732240356096:12345-192.168.204.54@tcp:35:cat.0 00000100:00100000:2.0:1788837970.887691:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+38:11575:x1875732240356096:12345-192.168.204.54@tcp:35:cat.0 Request processed in 806us (1056us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788837970.887702:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:3.0:1788837970.909599:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837970.909706:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240356352 00000100:00100000:1.0:1788837970.909716:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240356352 00000100:00100000:1.0:1788837970.909782:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 198 00000100:00100000:1.0:1788837970.909793:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+38:11576:x1875732240356352:12345-192.168.204.54@tcp:36:rm.0 00010000:00010000:1.0:1788837970.909880:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788837970.909913:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e707d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2c4 expref: 38 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.909938:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e7053 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2bd expref: 37 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.909971:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e701b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2af expref: 36 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.909984:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a460c5e800) 00010000:00010000:1.0:1788837970.909995:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788837970.910017:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e708b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.910031:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e708b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.910040:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e708b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.910053:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e7092 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.910059:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e7092 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.910065:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e7092 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.910436:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e7099 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.910446:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e7099 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.910453:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e7099 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788837970.911027:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1788837970.911037:0:5808:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 351004833932ns, next at 352004831821ns, rc = 0 00010000:00010000:1.0:1788837970.911102:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e70a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.911130:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e70a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.911138:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e70a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.911144:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e70a0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.911150:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e70a0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.911155:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e70a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.913306:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837970.913357:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e7099 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.913367:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e7099 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.913374:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e7099 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.913380:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3d000 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837970.913404:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e7099 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.913412:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e7099 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.913429:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a45487f800) 00010000:00010000:1.0:1788837970.913433:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788837970.913437:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e7099 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.913444:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e7099 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.913468:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e708b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.913474:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e708b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.913479:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e708b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.913484:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3d200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837970.913486:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e708b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.913492:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e708b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.913499:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:1.0:1788837970.913502:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837970.913521:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e708b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.913527:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e708b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788837970.913539:0:5808:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f6f8e011 reply state 00000000776c79cb transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e7092 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837970.913548:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788837970.913641:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+37:11576:x1875732240356352:12345-192.168.204.54@tcp:36:rm.0 Request processed in 3846us (4049us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1788837970.913650:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 198 00010000:00010000:3.0:1788837970.916026:0:7597:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837970.916041:0:7597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e70a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.916460:0:7597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3c600 already unused, calling callback (ffffffffc1616420) 00010000:00010000:3.0:1788837970.916464:0:7597:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e70a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.916474:0:7597:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e70a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.916494:0:7597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a45487f800) 00010000:00010000:3.0:1788837970.916497:0:7597:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788837970.916511:0:7597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e70a0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.916518:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e70a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.917008:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e7092 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.917019:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e7092 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.917025:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e7092 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.917030:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837970.917030:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3c400 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837970.917032:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837970.917034:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837970.917035:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e7092 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.917041:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e7092 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.917053:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a45487f500) 00010000:00010000:0.0:1788837970.917056:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837970.917059:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e7092 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.917074:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c400/0x2deb895b363e7092 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837970.969136:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837970.971481:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240356608 00000100:00100000:2.0:1788837970.971495:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240356608 00000100:00100000:0.0:1788837970.972079:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 199 00000100:00100000:0.0:1788837970.972091:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+36:11582:x1875732240356608:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1788837970.972120:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837970.972143:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e70a7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d2cb expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.972371:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e70ae lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.972387:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e70ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.972400:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e70ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.972415:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e70b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.972422:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e70b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.972428:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e70b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788837970.977457:0:5809:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788837970.985458:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e70bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.985497:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e70bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.986028:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e70bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.986096:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e70ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.986105:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e70ae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.986112:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e70ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.986119:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e791000 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837970.986123:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e70ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.986131:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e70ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.986146:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:0.0:1788837970.986149:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837970.986153:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e70ae lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.986159:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e70ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788837970.986176:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053e374a5 reply state 000000003f6c6ebd transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e70b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837970.986971:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788837970.987020:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e70a7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2cb expref: 39 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.987037:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e70bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2cb expref: 38 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.987045:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58600) 00010000:00010000:0.0:1788837970.987047:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837970.987050:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e791400, rc 0) 00000100:00100000:0.0:1788837970.987240:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+39:11582:x1875732240356608:12345-192.168.204.54@tcp:101:bash.0 Request processed in 15149us (18112us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788837970.987248:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 199 00000100:00100000:1.0:1788837970.997928:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837970.998589:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240356736 00000100:00100000:2.0:1788837970.998601:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240356736 00000100:00100000:2.0:1788837970.998693:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:2.0:1788837970.998704:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2351:x1875732240356736:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788837970.998721:0:6652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837970.998746:0:6652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bea8b964/0x2deb895b363e70ca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d2d2 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788837970.998773:0:6652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788837970.998803:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=351s v=(0 0) 00010000:00010000:2.0:1788837970.998808:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837970.998818:0:6652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bea8b964/0x2deb895b363e70ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2d2 expref: 6 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.998837:0:6652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bea8b964/0x2deb895b363e70ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2d2 expref: 6 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.998850:0:6652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5800, rc 0) 00000100:00100000:2.0:1788837970.998925:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2351:x1875732240356736:12345-192.168.204.54@tcp:101:bash.0 Request processed in 223us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837970.998932:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 59 00010000:00010000:3.0:1788837971.000761:0:3257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e70b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.000787:0:3257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e70b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.000795:0:3257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e70b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.000801:0:3257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e790000 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837971.000806:0:3257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e70b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.000830:0:3257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e70b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.000847:0:3257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a462b58c00) 00010000:00010000:3.0:1788837971.000850:0:3257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837971.000855:0:3257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e70b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.000861:0:3257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e70b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837971.006671:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837971.007134:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240356864 00000100:00100000:2.0:1788837971.007157:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240356864 00000100:00100000:2.0:1788837971.007267:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:2.0:1788837971.007278:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:11582:x1875732240356864:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788837971.007298:0:6650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837971.007320:0:6650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0fec911/0x2deb895b363e70d1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d2d9 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.007367:0:6650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bea8b964/0x2deb895b363e70ca lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2d2 expref: 7 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.007377:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837971.007382:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837971.007388:0:6650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0fec911/0x2deb895b363e70d1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2d9 expref: 7 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.007426:0:6650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bea8b964/0x2deb895b363e70ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2d2 expref: 7 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.007441:0:6650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bea8b964/0x2deb895b363e70ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2d2 expref: 7 pid: 6652 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837971.007459:0:6650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b09b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6650:1875732255027328:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788837971.007679:0:6650:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4601b2e40 going to sleep for 11 seconds 00000100:00080000:3.0:1788837971.008480:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788837971.015362:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837971.016792:0:6650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b09b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6650:1875732255027328:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788837971.016831:0:6650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e0fec911/0x2deb895b363e70d1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2d9 expref: 7 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.016871:0:6650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5e00, rc 0) 00000100:00100000:2.0:1788837971.016930:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:11582:x1875732240356864:12345-192.168.204.54@tcp:101:bash.0 Request processed in 9655us (10285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837971.016939:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:1.0:1788837971.017760:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240356992 00000100:00100000:1.0:1788837971.017770:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240356992 00010000:00010000:1.0:1788837971.017820:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bea8b964/0x2deb895b363e70ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2d2 expref: 7 pid: 6652 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837971.017856:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 75 00000100:00100000:1.0:1788837971.017866:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2352:x1875732240356992:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837971.017880:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837971.017901:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bea8b964/0x2deb895b363e70ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2d2 expref: 7 pid: 6652 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.017912:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bea8b964/0x2deb895b363e70ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2d2 expref: 7 pid: 6652 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.017949:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bea8b964/0x2deb895b363e70ca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2d2 expref: 7 pid: 6652 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.017963:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837971.017967:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837971.017974:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0fec911/0x2deb895b363e70d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2d9 expref: 6 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.017983:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0fec911/0x2deb895b363e70d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2d9 expref: 6 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.018017:0:5793:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e0fec911/0x2deb895b363e70d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2d9 expref: 6 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837971.018030:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ec3df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5793:1875732255027456:192.168.204.54@tcp:105: 00000100:00100000:1.0:1788837971.018106:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a450a27f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788837971.033261:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837971.033553:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ec3df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5793:1875732255027456:192.168.204.54@tcp:105: 00010000:00010000:1.0:1788837971.033589:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837971.033637:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2352:x1875732240356992:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 15772us (18285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837971.033647:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 75 00000100:00100000:3.0:1788837971.033847:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240357248 00000100:00100000:3.0:1788837971.033855:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240357248 00000100:00100000:3.0:1788837971.033917:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:3.0:1788837971.033927:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b09b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+38:11582:x1875732240357248:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:3.0:1788837971.034262:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b09b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+39:11582:x1875732240357248:12345-192.168.204.54@tcp:35:bash.0 Request processed in 336us (1011us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788837971.034269:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00080000:1.0:1788837971.034467:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837971.300168:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837971.301379:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240357376 00000100:00100000:0.0:1788837971.301393:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240357376 00000100:00100000:0.0:1788837971.301468:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 200 00000100:00100000:0.0:1788837971.301480:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+39:11598:x1875732240357376:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788837971.301515:0:7972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837971.301538:0:7972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e70d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d2e0 expref: -99 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.302024:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e70df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.302041:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e70df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.302071:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e70df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837971.302108:0:7972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788837971.302113:0:7972:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788837971.302132:0:7972:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e70df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.302160:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e70d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2e0 expref: 41 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.302180:0:7972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e70df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2e0 expref: 40 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.304452:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:0.0:1788837971.304463:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788837971.304470:0:7972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e790200, rc 0) 00000100:00100000:0.0:1788837971.304563:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+40:11598:x1875732240357376:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 3081us (4401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837971.304573:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 200 00000100:00100000:0.0:1788837971.324646:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837971.324787:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240357632 00000100:00100000:1.0:1788837971.324798:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240357632 00000100:00100000:1.0:1788837971.324905:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 201 00000100:00100000:1.0:1788837971.324916:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+40:11598:x1875732240357632:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788837971.324940:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837971.324962:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e70e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d2e7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.325063:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e70ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.325077:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e70ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.325088:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e70ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837971.325098:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788837971.325255:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e70e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2e7 expref: 43 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.325273:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e70ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2e7 expref: 42 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.325282:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58600) 00010000:00010000:1.0:1788837971.325285:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837971.325288:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3c800, rc 0) 00000100:00100000:1.0:1788837971.325364:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+42:11598:x1875732240357632:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 450us (728us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788837971.325371:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 201 00000100:00100000:2.0:1788837971.337087:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837971.337145:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837971.337252:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240357888 00000100:00100000:0.0:1788837971.337263:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240357888 00000100:00100000:0.0:1788837971.337337:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 202 00000100:00100000:0.0:1788837971.337348:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b09bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+42:11598:x1875732240357888:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788837971.337373:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837971.337396:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e70fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d2ee expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.337513:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e7102 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.337528:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e7102 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.337539:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e7102 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837971.337552:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788837971.337689:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e70fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2ee expref: 45 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.337708:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e7102 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2ee expref: 44 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.337716:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58600) 00010000:00010000:0.0:1788837971.337719:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788837971.337722:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e791e00, rc 0) 00000100:00100000:0.0:1788837971.337788:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b09bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+44:11598:x1875732240357888:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 442us (711us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788837971.337795:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 202 00000100:00100000:3.0:1788837971.338059:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240358016 00000100:00100000:3.0:1788837971.338065:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240358016 00000100:00100000:3.0:1788837971.338112:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:3.0:1788837971.338120:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f35c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+44:2352:x1875732240358016:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837971.338131:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837971.338146:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e70ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2e7 expref: 44 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.338171:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58600) 00010000:00010000:3.0:1788837971.338174:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837971.338197:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f35c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+43:2352:x1875732240358016:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 78us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837971.338259:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:2.0:1788837971.371918:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837971.372990:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240358144 00000100:00100000:0.0:1788837971.373004:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240358144 00000100:00100000:0.0:1788837971.373082:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:0.0:1788837971.373093:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b099c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+6:2350:x1875732240358144:12345-192.168.204.54@tcp:1:lfs.0 00010000:00010000:0.0:1788837971.373157:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e589142/0x2deb895b363e7110 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.373197:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0fec911/0x2deb895b363e70d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2d9 expref: 6 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.373249:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837971.373254:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788837971.373260:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e589142/0x2deb895b363e7110 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.373302:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e0fec911/0x2deb895b363e70d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2d9 expref: 6 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.373327:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e0fec911/0x2deb895b363e70d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2d9 expref: 6 pid: 6650 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837971.373344:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a45108e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6682:1875732255027584:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788837971.373461:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4628d1180 going to sleep for 11 seconds 00000100:00100000:2.0:1788837971.381110:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837971.381254:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a45108e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6682:1875732255027584:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788837971.381283:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000e589142/0x2deb895b363e7110 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837971.381811:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240358272 00000100:00100000:1.0:1788837971.381836:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240358272 00002000:00100000:1.0:1788837971.382114:0:6656:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff97a47b098700 x1875732240358272/t0(0) o4->f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7@192.168.204.54@tcp:627/0 lens 504/0 e 0 to 0 dl 1788837982 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788837971.382125:0:6656:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a47b098700 with x1875732240358272 ext(0->8) 00010000:00010000:1.0:1788837971.382133:0:6656:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e0fec911/0x2deb895b363e70d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2d9 expref: 7 pid: 6650 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.382148:0:6656:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e0fec911/0x2deb895b363e70d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2d9 expref: 7 pid: 6650 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788837971.382156:0:6656:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff97a47b098700 00000100:00100000:1.0:1788837971.382309:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:1.0:1788837971.382330:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2351:x1875732240358272:12345-192.168.204.54@tcp:4:lfs.0 00000100:00100000:1.0:1788837971.383338:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+9:2351:x1875732240358272:12345-192.168.204.54@tcp:4:lfs.0 Request processed in 1014us (2229us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788837971.383349:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00002000:00100000:1.0:1788837971.383360:0:6656:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff97a47b098700 x1875732240358272/t4294967308(0) o4->f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7@192.168.204.54@tcp:627/0 lens 504/448 e 0 to 0 dl 1788837982 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788837971.383369:0:6656:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a47b098700 with x1875732240358272 ext(0->8) 00010000:00010000:1.0:1788837971.383378:0:6656:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e0fec911/0x2deb895b363e70d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2d9 expref: 9 pid: 6650 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.383395:0:6656:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e0fec911/0x2deb895b363e70d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2d9 expref: 9 pid: 6650 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788837971.383415:0:6656:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff97a47b098700 00000100:00100000:0.0:1788837971.388704:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837971.388789:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240358400 00000100:00100000:3.0:1788837971.388800:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240358400 00010000:00010000:3.0:1788837971.388843:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e0fec911/0x2deb895b363e70d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2d9 expref: 9 pid: 6650 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837971.389082:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 76 00000100:00100000:3.0:1788837971.389092:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+9:2352:x1875732240358400:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837971.389108:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788837971.389126:0:5795:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788837971.389129:0:5795:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788837970 00002000:00010000:3.0:1788837971.389131:0:5795:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788837970 00002000:00010000:3.0:1788837971.389134:0:5795:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788837970 00010000:00010000:3.0:1788837971.389140:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e0fec911/0x2deb895b363e70d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2d9 expref: 9 pid: 6650 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.389154:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e0fec911/0x2deb895b363e70d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2d9 expref: 9 pid: 6650 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.389177:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0fec911/0x2deb895b363e70d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2d9 expref: 9 pid: 6650 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.389245:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788837971.389250:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788837971.389257:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000e589142/0x2deb895b363e7110 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.389267:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e589142/0x2deb895b363e7110 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.389301:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837971.389371:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:2352:x1875732240358400:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 281us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837971.389379:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 76 00010000:00010000:0.0:1788837971.389616:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000e589142/0x2deb895b363e7110 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.389638:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e589142/0x2deb895b363e7110 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.389679:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e589142/0x2deb895b363e7110 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.389689:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e589142/0x2deb895b363e7110 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.389697:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e589142/0x2deb895b363e7110 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.389705:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e791600 already unused, calling callback (ffffffffc1616420) 00010000:00010000:0.0:1788837971.389710:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e589142/0x2deb895b363e7110 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.389720:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e589142/0x2deb895b363e7110 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.389734:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e589142/0x2deb895b363e7110 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.389742:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e589142/0x2deb895b363e7110 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837971.389820:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b099c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2350:x1875732240358144:12345-192.168.204.54@tcp:1:lfs.0 Request processed in 16727us (17912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837971.389829:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:0.0:1788837971.397171:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837971.397411:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240358656 00000100:00100000:3.0:1788837971.397424:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240358656 00000100:00100000:3.0:1788837971.397545:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:3.0:1788837971.397556:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4713ab050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+43:11598:x1875732240358656:12345-192.168.204.54@tcp:35:lfs.0 00000004:00010000:3.0:1788837971.397635:0:5811:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e7102 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2ee expref: 43 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788837971.397917:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1788837971.397965:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1788837971.398359:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1788837971.398419:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7117 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.398436:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e70bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2cb expref: 47 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.398461:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7117 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.398496:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e70bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2cb expref: 47 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.398514:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e70bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2cb expref: 47 pid: 5809 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837971.398529:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ead0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5811:1875732255027712:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788837971.398620:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b52c300 going to sleep for 11 seconds 00000100:00100000:1.0:1788837971.406768:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837971.406871:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ead0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5811:1875732255027712:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788837971.406900:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7117 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837971.407086:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240358784 00000100:00100000:3.0:1788837971.407093:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240358784 00010000:00010000:3.0:1788837971.407128:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e70bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2cb expref: 48 pid: 5809 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837971.407165:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:3.0:1788837971.407173:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+48:2351:x1875732240358784:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837971.407187:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837971.407404:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e70bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2cb expref: 48 pid: 5809 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.407418:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e70bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2cb expref: 48 pid: 5809 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.407441:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e70bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2cb expref: 48 pid: 5809 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.407467:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58600) 00010000:00010000:3.0:1788837971.407473:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7117 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.407482:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7117 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.407490:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7117 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.407794:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837971.407859:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+47:2351:x1875732240358784:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 685us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837971.407868:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 77 00010000:00010000:0.0:1788837971.415895:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7117 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.415916:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7117 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788837971.416065:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788837971.416342:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1788837971.416474:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a45108d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5811:1875732255027840:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788837971.416560:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837971.416616:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448e43240 going to sleep for 11 seconds 00000100:00100000:1.0:1788837971.417145:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255027840 00000100:00100000:1.0:1788837971.417153:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255027840 00000100:00100000:1.0:1788837971.417263:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788837971.417274:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5811:x1875732255027840:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788837971.417374:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5811:x1875732255027840:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 102us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837971.417382:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788837971.418024:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788837971.418142:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a45108d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5811:1875732255027840:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788837971.419261:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1788837971.419357:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b09aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5811:1875732255027968:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788837971.419411:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837971.419446:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4601b2900 going to sleep for 11 seconds 00000100:00100000:1.0:1788837971.419841:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255027968 00000100:00100000:1.0:1788837971.419850:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255027968 00000100:00100000:1.0:1788837971.419908:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788837971.419917:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b09ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5811:x1875732255027968:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788837971.420086:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b09ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5811:x1875732255027968:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 170us (674us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788837971.420094:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788837971.420293:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b09aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5811:1875732255027968:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788837971.420360:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1788837971.420396:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7117 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.420407:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7117 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.420414:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7117 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.420420:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48ba00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837971.420433:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7117 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.420441:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7117 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.420457:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58600) 00010000:00010000:2.0:1788837971.420460:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788837971.420465:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7117 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.420472:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7117 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788837971.420828:0:5811:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788837971.421081:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1788837971.421091:0:5811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 351514888003ns, next at 352514886155ns, rc = 0 00000001:00080000:2.0:1788837971.421098:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1788837971.421129:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58600) 00010000:00010000:2.0:1788837971.421132:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788837971.421139:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e7102 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2ee expref: 51 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837971.421261:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4713ab050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+50:11598:x1875732240358656:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 23707us (24101us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1788837971.421269:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 56 00000020:00080000:2.0:1788837971.421273:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788837971.425683:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837971.425767:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240358912 00000100:00100000:0.0:1788837971.425777:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240358912 00000100:00100000:0.0:1788837971.425835:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 203 00000100:00100000:0.0:1788837971.425854:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+50:11598:x1875732240358912:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788837971.425886:0:7972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837971.425922:0:7972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e711e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d2f5 expref: -99 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.425984:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e711e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2f5 expref: 51 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.425999:0:7972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e711e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2f5 expref: 51 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.426019:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58400) 00010000:00010000:0.0:1788837971.426022:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788837971.426026:0:7972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e791c00, rc 0) 00000100:00100000:0.0:1788837971.426096:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+51:11598:x1875732240358912:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 252us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837971.426103:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 203 00000100:00100000:1.0:1788837971.439352:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837971.439509:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240359168 00000100:00100000:1.0:1788837971.439519:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240359168 00000100:00100000:1.0:1788837971.439577:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:1.0:1788837971.439599:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+51:11598:x1875732240359168:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1788837971.439875:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+52:11598:x1875732240359168:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 279us (535us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1788837971.439883:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 57 00010000:00010000:2.0:1788837971.490992:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837971.618592:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837971.618614:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ead3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255028096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837971.618693:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837971.619129:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255028096 00000100:00100000:3.0:1788837971.619138:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255028096 00000100:00100000:3.0:1788837971.619224:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788837971.619235:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3272:x1875732255028096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788837971.619269:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788837971.619358:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3272:x1875732255028096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837971.619365:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788837971.619467:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ead3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255028096:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788837971.619901:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837971.639370:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837971.642293:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240359296 00000100:00100000:0.0:1788837971.642308:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240359296 00000100:00100000:0.0:1788837971.642949:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 204 00000100:00100000:0.0:1788837971.642961:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+52:11608:x1875732240359296:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:0.0:1788837971.643051:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e7125 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.643072:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e7125 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.643084:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e7125 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.643125:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e712c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.643134:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e712c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.643141:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e712c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.643263:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e7133 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.643273:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e7133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.643279:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e7133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788837971.643329:0:10730:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e7133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.643353:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e7125 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.643361:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e7125 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.643368:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e7125 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.643375:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e790000 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837971.643378:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e7125 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.643393:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e7125 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.643407:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:0.0:1788837971.643410:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837971.643416:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e7125 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.643423:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e7125 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.643436:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e712c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.643441:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e712c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.643448:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e712c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.643454:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e790800 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837971.643456:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e712c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.643462:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e712c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.643469:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a462b58100) 00010000:00010000:0.0:1788837971.643471:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837971.643474:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e712c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.643505:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e712c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.643520:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e7133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.643525:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e7133 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.643529:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e7133 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.643533:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e791e00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837971.643536:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e7133 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.643541:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e7133 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.643547:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58400) 00010000:00010000:0.0:1788837971.643549:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837971.643552:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e7133 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.643556:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e7133 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837971.643667:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+52:11608:x1875732240359296:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 707us (4305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837971.643675:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 204 00000100:00100000:1.0:1788837971.721911:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837971.722032:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240359552 00000100:00100000:0.0:1788837971.722052:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240359552 00000100:00100000:0.0:1788837971.722138:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 205 00000100:00100000:0.0:1788837971.722159:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+52:11611:x1875732240359552:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788837971.722180:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837971.722255:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e713a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d2fc expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.722350:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e7141 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.722365:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e7141 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.722377:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e7141 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.722392:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e7148 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.722399:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e7148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.722406:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e7148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.722531:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e714f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.722540:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e714f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.722568:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e714f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837971.722579:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788837971.722702:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e7141 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.722710:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e7141 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.722717:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e7141 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.722723:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e790800 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837971.722727:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e7141 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.722734:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e7141 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.722747:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:0.0:1788837971.722750:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837971.722755:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e7141 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.722761:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e7141 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.722774:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e7148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.722781:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e7148 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.722794:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e7148 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.722799:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e790000 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837971.722802:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e7148 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.722808:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e7148 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.722816:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a462b58100) 00010000:00010000:0.0:1788837971.722818:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837971.722821:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e7148 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.722826:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e7148 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.722868:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791e00/0x2deb895b363e713a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2fc expref: 55 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.722881:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e714f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2fc expref: 54 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.722888:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58400) 00010000:00010000:0.0:1788837971.722891:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837971.722893:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e791400, rc 0) 00000100:00100000:0.0:1788837971.722986:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+54:11611:x1875732240359552:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 838us (1091us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1788837971.723003:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 205 00000100:00100000:2.0:1788837971.729755:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837971.729935:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240359680 00000100:00100000:3.0:1788837971.729946:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240359680 00000100:00100000:3.0:1788837971.730039:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 206 00000100:00100000:3.0:1788837971.730049:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b09b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+54:11611:x1875732240359680:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:3.0:1788837971.730138:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e715d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.730156:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e715d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.730167:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e715d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.730193:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e715d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.730200:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e715d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.730241:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e715d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.730248:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48b200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837971.730253:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e715d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.730260:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e715d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.730272:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58400) 00010000:00010000:3.0:1788837971.730275:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788837971.730280:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e715d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.730286:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e715d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837971.730381:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b09b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+54:11611:x1875732240359680:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 332us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837971.730389:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 206 00000100:00100000:3.0:1788837971.735274:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837971.735958:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240359936 00000100:00100000:1.0:1788837971.735972:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240359936 00000100:00100000:1.0:1788837971.736090:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:1.0:1788837971.736102:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ead3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+54:11611:x1875732240359936:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1788837971.736456:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ead3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+55:11611:x1875732240359936:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 355us (1190us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788837971.736464:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:1.0:1788837971.830916:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837971.832860:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240360192 00000100:00100000:0.0:1788837971.832876:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240360192 00000100:00100000:0.0:1788837971.832961:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 207 00000100:00100000:0.0:1788837971.832971:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+55:11621:x1875732240360192:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1788837971.832997:0:10730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837971.833000:0:10730:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788837971.833028:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e70df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2e0 expref: 55 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.833048:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:0.0:1788837971.833054:0:10730:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837971.833068:0:10730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e7164 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d303 expref: -99 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.833172:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e716b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.833186:0:10730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e714f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2fc expref: 55 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.833195:0:10730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e716b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.833287:0:10730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e714f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2fc expref: 55 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.833302:0:10730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e714f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2fc expref: 55 pid: 5810 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837971.833484:0:10730:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a45108d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10730:1875732255028224:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788837971.833605:0:10730:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448e43f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788837971.842181:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837971.842322:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240360320 00000100:00100000:2.0:1788837971.842354:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240360320 00010000:00010000:2.0:1788837971.842397:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e714f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2fc expref: 56 pid: 5810 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837971.842440:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:2.0:1788837971.842450:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+56:2351:x1875732240360320:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837971.842464:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837971.842471:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e714f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2fc expref: 56 pid: 5810 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.842485:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e714f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2fc expref: 56 pid: 5810 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.842507:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58400) 00010000:00010000:2.0:1788837971.842513:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e716b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.842522:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e716b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.842529:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e716b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.842548:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837971.842609:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+56:2351:x1875732240360320:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 160us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837971.842616:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 78 00010000:00010000:1.0:1788837971.843166:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e714f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2fc expref: 55 pid: 5810 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837971.843184:0:10730:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a45108d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10730:1875732255028224:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788837971.843255:0:10730:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e716b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.843265:0:10730:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e716b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.843271:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e716b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837971.843293:0:10730:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788837971.843490:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e7164 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d303 expref: 56 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.843523:0:10730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e716b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d303 expref: 55 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.843531:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58400) 00010000:00010000:1.0:1788837971.843534:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788837971.843536:0:10730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e790800, rc 0) 00000100:00100000:1.0:1788837971.843573:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+55:11621:x1875732240360192:12345-192.168.204.54@tcp:101:bash.0 Request processed in 10603us (12668us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1788837971.843580:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 207 00000100:00100000:3.0:1788837971.851421:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837971.853892:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240360576 00000100:00100000:2.0:1788837971.853908:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240360576 00000100:00100000:2.0:1788837971.853993:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 208 00000100:00100000:2.0:1788837971.854002:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+55:11621:x1875732240360576:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:2.0:1788837971.854332:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e7179 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.854349:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e7179 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.854361:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e7179 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788837971.854415:0:7972:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1788837971.854443:0:7972:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae0acc7e reply state 00000000e3592d05 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e7179 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837971.854450:0:7972:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788837971.854564:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+58:11621:x1875732240360576:12345-192.168.204.54@tcp:36:bash.0 Request processed in 561us (3155us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788837971.854572:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 208 00000020:00080000:2.0:1788837971.854577:0:7972:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788837971.860380:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e7179 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.860398:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e7179 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.860406:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e7179 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.860413:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837971.860419:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e7179 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.860426:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e7179 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.860447:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58400) 00010000:00010000:3.0:1788837971.860450:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837971.860456:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e7179 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.860462:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e7179 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837971.861586:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837971.863630:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240360704 00000100:00100000:0.0:1788837971.863645:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240360704 00000100:00100000:0.0:1788837971.863732:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 209 00000100:00100000:0.0:1788837971.863745:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f47fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+57:11621:x1875732240360704:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1788837971.863775:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837971.863798:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e7180 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d30a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.863905:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e7187 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.863921:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e716b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d303 expref: 58 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.863930:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e7187 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.863965:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e716b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d303 expref: 58 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.863978:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e716b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d303 expref: 58 pid: 10730 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837971.863991:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a45108f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5808:1875732255028352:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788837971.864094:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448e43240 going to sleep for 11 seconds 00000100:00100000:3.0:1788837971.867418:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a45108f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5808:1875732255028352:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788837971.867452:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e7187 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837971.869115:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837971.869785:0:7599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240360832 00000100:00100000:1.0:1788837971.869805:0:7599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240360832 00010000:00010000:1.0:1788837971.869853:0:7599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e716b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d303 expref: 59 pid: 10730 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837971.869896:0:7599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 79 00000100:00100000:1.0:1788837971.869906:0:7599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f47d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+59:2352:x1875732240360832:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837971.869925:0:7599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837971.869932:0:7599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e716b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d303 expref: 59 pid: 10730 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.869947:0:7599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e716b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d303 expref: 59 pid: 10730 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.870030:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e716b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d303 expref: 59 pid: 10730 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.870066:0:7599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58400) 00010000:00010000:1.0:1788837971.870072:0:7599:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e7187 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.870081:0:7599:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e7187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.870089:0:7599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e7187 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.870151:0:7599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837971.870235:0:7599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f47d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+58:2352:x1875732240360832:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 329us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837971.870243:0:7599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 79 00010000:00010000:3.0:1788837971.871139:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e7187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.871152:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e7187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837971.871296:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788837971.871302:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788837971.871343:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e7187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.871386:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e7180 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d30a expref: 58 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.871408:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e7187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d30a expref: 57 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.871417:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58400) 00010000:00010000:3.0:1788837971.871421:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837971.871425:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e791000, rc 0) 00000100:00100000:3.0:1788837971.871553:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f47fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+57:11621:x1875732240360704:12345-192.168.204.54@tcp:101:bash.0 Request processed in 7810us (9974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837971.871562:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 209 00000100:00100000:3.0:1788837971.884161:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837971.884514:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240361088 00000100:00100000:2.0:1788837971.884527:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240361088 00000100:00100000:2.0:1788837971.884647:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:2.0:1788837971.884659:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f47c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+57:11621:x1875732240361088:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:2.0:1788837971.884927:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f47c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+58:11621:x1875732240361088:12345-192.168.204.54@tcp:35:bash.0 Request processed in 270us (775us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1788837971.884936:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:0.0:1788837972.007379:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837972.009736:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240361216 00000100:00100000:1.0:1788837972.009754:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240361216 00000100:00100000:1.0:1788837972.009914:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 210 00000100:00100000:1.0:1788837972.009925:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+58:11627:x1875732240361216:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788837972.009951:0:10730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837972.009973:0:10730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e718e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d311 expref: -99 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837972.010038:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e7195 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837972.010052:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e7195 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837972.010084:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e7195 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837972.010118:0:10730:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788837972.010122:0:10730:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788837972.010139:0:10730:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e7195 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837972.010162:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c800/0x2deb895b363e718e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d311 expref: 60 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837972.010181:0:10730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e7195 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d311 expref: 59 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837972.010189:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:1.0:1788837972.010193:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788837972.010196:0:10730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3d000, rc 0) 00000100:00100000:1.0:1788837972.010367:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+59:11627:x1875732240361216:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 443us (3004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837972.010374:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 210 00000100:00100000:0.0:1788837972.025999:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837972.026484:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240361344 00000100:00100000:2.0:1788837972.026495:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240361344 00000100:00100000:2.0:1788837972.026646:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 211 00000100:00100000:2.0:1788837972.026658:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+59:11627:x1875732240361344:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788837972.026681:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837972.026705:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e719c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d318 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.026791:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e71a3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.026806:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e71a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.026819:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e71a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.026835:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e71aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.026842:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e71aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.026849:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e71aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.026942:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e71b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.026951:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e71b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.026958:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e71b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837972.027005:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788837972.027009:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837972.027030:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e71b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.027042:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e71b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.027050:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e71a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.027056:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e71a3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.027062:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e71a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.027068:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837972.027073:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e71a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.027080:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e71a3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.027094:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:2.0:1788837972.027097:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837972.027102:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e71a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.027108:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e71a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.027136:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e71aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.027142:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e71aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.027148:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e71aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.027153:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4e00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837972.027156:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e71aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.027161:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e71aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.027169:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a448b3c300) 00010000:00010000:2.0:1788837972.027172:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837972.027175:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e71aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.027180:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e71aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.027261:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e719c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d318 expref: 61 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.027277:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e71b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d318 expref: 60 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.027296:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58400) 00010000:00010000:2.0:1788837972.027298:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837972.027301:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5200, rc 0) 00000100:00100000:2.0:1788837972.027392:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+60:11627:x1875732240361344:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 736us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837972.027401:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 211 00000100:00100000:0.0:1788837972.039947:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837972.039997:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837972.040092:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240361600 00000100:00100000:2.0:1788837972.040103:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240361600 00000100:00100000:2.0:1788837972.040180:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:2.0:1788837972.040191:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+60:2351:x1875732240361600:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837972.040248:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837972.040274:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e71b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d318 expref: 60 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.040293:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58400) 00010000:00010000:2.0:1788837972.040299:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837972.040363:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+59:2351:x1875732240361600:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 175us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837972.040371:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:3.0:1788837972.040437:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240361728 00000100:00100000:3.0:1788837972.040442:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240361728 00000100:00100000:3.0:1788837972.040482:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 212 00000100:00100000:3.0:1788837972.040499:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+59:11627:x1875732240361728:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788837972.040517:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837972.040534:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e71b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d31f expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837972.040631:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e71bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837972.040658:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e7187 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d30a expref: 60 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837972.040667:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e71bf lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837972.040711:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e7187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d30a expref: 60 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837972.040725:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e7187 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d30a expref: 60 pid: 5808 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837972.040738:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b660e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5808:1875732255028480:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788837972.040807:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b52c180 going to sleep for 11 seconds 00000100:00100000:3.0:1788837972.046567:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b660e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5808:1875732255028480:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788837972.046603:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e71bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837972.056429:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837972.056643:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240361856 00000100:00100000:3.0:1788837972.056654:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240361856 00010000:00010000:3.0:1788837972.056697:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e7187 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d30a expref: 61 pid: 5808 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837972.056804:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:3.0:1788837972.056815:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b0a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+61:2352:x1875732240361856:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837972.056830:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837972.056837:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e7187 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d30a expref: 61 pid: 5808 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837972.056851:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e7187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d30a expref: 61 pid: 5808 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837972.056875:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e7187 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d30a expref: 61 pid: 5808 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837972.056894:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58400) 00010000:00010000:3.0:1788837972.056900:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e71bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837972.056910:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e71bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837972.056918:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e71bf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837972.056953:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837972.057044:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b0a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+60:2352:x1875732240361856:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 231us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837972.057053:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 80 00010000:00010000:0.0:1788837972.057176:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e71bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837972.057184:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e71bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837972.057223:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788837972.057393:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e71b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d31f expref: 61 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837972.057411:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e71bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d31f expref: 60 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837972.057424:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58400) 00010000:00010000:0.0:1788837972.057427:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788837972.057430:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48a000, rc 0) 00000100:00100000:0.0:1788837972.057471:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+60:11627:x1875732240361728:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 16973us (17473us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788837972.057478:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 212 00000100:00100000:0.0:1788837972.065787:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837972.065940:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240362112 00000100:00100000:2.0:1788837972.065951:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240362112 00000100:00100000:2.0:1788837972.066013:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:2.0:1788837972.066024:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f34850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+60:11627:x1875732240362112:12345-192.168.204.54@tcp:103:lfs.0 00010000:00010000:2.0:1788837972.066039:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837972.066066:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791c00/0x2deb895b363e711e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2f5 expref: 60 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.066095:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58400) 00010000:00010000:2.0:1788837972.066100:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837972.066162:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f34850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+59:11627:x1875732240362112:12345-192.168.204.54@tcp:103:lfs.0 Request processed in 139us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837972.066169:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:2.0:1788837972.069077:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837972.072483:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240362240 00000100:00100000:1.0:1788837972.072725:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240362240 00000100:00100000:1.0:1788837972.073101:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 213 00000100:00100000:1.0:1788837972.073115:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+59:11627:x1875732240362240:12345-192.168.204.54@tcp:58:lfs.0 00010000:00010000:1.0:1788837972.073247:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e71cd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837972.073266:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e71cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837972.073296:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e71cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788837972.073536:0:10730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788837972.073866:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+59:11627:x1875732240362240:12345-192.168.204.54@tcp:58:lfs.0 Request processed in 752us (4795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837972.073875:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 213 00000100:00100000:1.0:1788837972.082152:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837972.082291:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240362368 00000100:00100000:2.0:1788837972.082301:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240362368 00000100:00100000:2.0:1788837972.082386:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 214 00000100:00100000:2.0:1788837972.082397:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+59:11627:x1875732240362368:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788837972.082419:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837972.082442:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e71d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d326 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.082863:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e71cd lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.082878:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e71d4 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d326 expref: 60 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.082899:0:5809:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e71cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.082914:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e71d4 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d326 expref: 60 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.082930:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58400) 00010000:00010000:2.0:1788837972.082950:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788837972.082954:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e71d4 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d326 expref: 60 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.083017:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4e00, rc 0) 00000100:00100000:2.0:1788837972.083093:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+60:11627:x1875732240362368:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 698us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837972.083101:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 214 00010000:00010000:1.0:1788837972.528055:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788837973.026935:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788837973.026950:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788837973.027846:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788837973.027859:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788837973.028812:0:11659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b660e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875732255028608:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788837973.028997:0:11659:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b52c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788837973.031999:0:11659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b660e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875732255028608:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788837973.032852:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837973.033018:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240362496 00000100:00100000:0.0:1788837973.033029:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240362496 00000100:00100000:0.0:1788837973.033123:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 215 00000100:00080000:2.0:1788837973.033128:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837973.033157:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+60:11628:x1875732240362496:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788837973.033200:0:5808:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788837973.033386:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+60:11628:x1875732240362496:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 233us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837973.033395:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 215 00000100:00100000:1.0:1788837973.042040:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837973.044267:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240362624 00000100:00100000:0.0:1788837973.044297:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240362624 00000100:00100000:0.0:1788837973.044407:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 216 00000100:00100000:0.0:1788837973.044420:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+60:11628:x1875732240362624:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788837973.044525:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e71db lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.044548:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e71db lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.044574:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e71db lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.044595:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e71e2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.044603:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e71e2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.044610:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e71e2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.044641:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e71e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.044677:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e71e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.044684:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e71e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837973.044739:0:10730:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788837973.044744:0:10730:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788837973.044761:0:10730:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e71e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.044774:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e71db lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.044781:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e71db lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.044788:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e71db lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.044795:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e790800 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837973.044800:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e71db lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.044809:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e71db lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.044823:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a448b3cf00) 00010000:00010000:0.0:1788837973.044827:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837973.044832:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e71db lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.044851:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e71db lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.044869:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e71e2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.044877:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e71e2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.044884:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e71e2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.044889:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e790200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837973.044892:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e71e2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.044898:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e71e2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.045174:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff97a462b58100) 00010000:00010000:0.0:1788837973.045177:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837973.045180:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e71e2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.045186:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e71e2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.045255:0:10730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e71e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.045262:0:10730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e71e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.045275:0:10730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e71e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.045281:0:10730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e790000 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837973.045295:0:10730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e71e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.045302:0:10730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e71e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.045311:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58400) 00010000:00010000:0.0:1788837973.045314:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837973.045317:0:10730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e71e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.045323:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e71e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837973.045437:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+60:11628:x1875732240362624:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 Request processed in 1017us (3410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837973.045447:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 216 00000100:00100000:2.0:1788837973.050514:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837973.050699:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240362880 00000100:00100000:0.0:1788837973.050713:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240362880 00000100:00100000:0.0:1788837973.050787:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 217 00000100:00100000:0.0:1788837973.050800:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b09b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+60:11628:x1875732240362880:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788837973.050830:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837973.050862:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e71f0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d32d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.051042:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e71f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.051061:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e71f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.051075:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e71f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837973.051088:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788837973.051249:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e71f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.051257:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e71f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.051263:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e71f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.051269:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e791400 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837973.051274:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e71f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.051282:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e71f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.051309:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58400) 00010000:00010000:0.0:1788837973.051312:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788837973.051317:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e71f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.051333:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e71f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.051391:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e71f0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d32d expref: 62 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.051402:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a448b3cf00) 00010000:00010000:0.0:1788837973.051405:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788837973.051409:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e71f0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d32d expref: 62 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.051425:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e791600, rc 0) 00000100:00100000:0.0:1788837973.051515:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b09b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+61:11628:x1875732240362880:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 717us (1020us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1788837973.051523:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 217 00000100:00100000:2.0:1788837973.055533:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837973.055676:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240363008 00000100:00100000:1.0:1788837973.055689:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240363008 00000100:00100000:1.0:1788837973.055771:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 218 00000100:00100000:1.0:1788837973.055784:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+61:11628:x1875732240363008:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788837973.055840:0:5810:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788837973.056124:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+61:11628:x1875732240363008:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 341us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837973.056132:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 218 00000100:00100000:1.0:1788837973.081669:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837973.081793:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240363264 00000100:00100000:0.0:1788837973.081806:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240363264 00000100:00100000:0.0:1788837973.081893:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 219 00000100:00100000:0.0:1788837973.081905:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+61:11628:x1875732240363264:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788837973.081933:0:10730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837973.081937:0:10730:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788837973.081974:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e7195 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d311 expref: 61 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.082001:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:0.0:1788837973.082019:0:10730:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837973.082060:0:10730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e7205 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d334 expref: -99 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788837973.082668:0:10730:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:0.0:1788837973.082924:0:10730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e720c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.082941:0:10730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e720c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.082953:0:10730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e720c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.083023:0:10730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e7205 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d334 expref: 63 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.083042:0:10730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e720c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d334 expref: 62 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.083050:0:10730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97a462b58100) 00010000:00010000:0.0:1788837973.083053:0:10730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837973.083056:0:10730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e791400, rc 0) 00000100:00100000:0.0:1788837973.083139:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+62:11628:x1875732240363264:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1236us (1485us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1788837973.083148:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 219 00000100:00100000:0.0:1788837973.097832:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837973.098259:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240363520 00000100:00100000:3.0:1788837973.098277:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240363520 00000100:00100000:3.0:1788837973.098374:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 220 00000100:00100000:3.0:1788837973.098386:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b0a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+62:11628:x1875732240363520:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788837973.098490:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837973.098526:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791400/0x2deb895b363e720c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d334 expref: 62 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.098560:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97a462b58100) 00010000:00010000:3.0:1788837973.098573:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788837973.098604:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e721a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.098623:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e721a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.098635:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e721a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.098673:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7221 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x44f36197 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.098682:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7221 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x44f36197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.098689:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7221 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x44f36197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.098772:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e721a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.098780:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e721a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.098787:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e721a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.098795:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48b200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837973.098800:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e721a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.098809:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e721a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.098818:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:3.0:1788837973.098821:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837973.098826:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e721a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.098832:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e721a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.098848:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7221 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x44f36197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.098855:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7221 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x44f36197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.098861:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7221 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x44f36197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.098867:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48ba00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837973.098870:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7221 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x44f36197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.098877:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7221 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x44f36197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.098884:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x44f36197 (ffff97a460c5e500) 00010000:00010000:3.0:1788837973.098887:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837973.098890:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7221 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x44f36197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.098896:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7221 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x44f36197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837973.099634:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b0a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+61:11628:x1875732240363520:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 1243us (1813us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788837973.099646:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 220 00000100:00100000:1.0:1788837973.111764:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837973.111889:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240363648 00000100:00100000:2.0:1788837973.111904:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240363648 00000100:00100000:2.0:1788837973.112132:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 221 00000100:00100000:2.0:1788837973.112146:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+61:11628:x1875732240363648:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837973.112172:0:7972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837973.112263:0:7972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e7228 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d33b expref: -99 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.112330:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e722f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.112348:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e722f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.112362:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e722f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.112512:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e7228 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d33b expref: 63 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.112545:0:7972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e722f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d33b expref: 62 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.112556:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97a448b3c300) 00010000:00010000:2.0:1788837973.112559:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788837973.112564:0:7972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5600, rc 0) 00000100:00100000:2.0:1788837973.112657:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+62:11628:x1875732240363648:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 515us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837973.112665:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 221 00000100:00100000:2.0:1788837973.123746:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837973.123852:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240363904 00000100:00100000:0.0:1788837973.123866:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240363904 00000100:00100000:0.0:1788837973.123944:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 222 00000100:00100000:0.0:1788837973.123968:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+62:11628:x1875732240363904:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788837973.124149:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e7236 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.124172:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e7236 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.124187:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e7236 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788837973.124653:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1788837973.124667:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 353218463173ns, next at 354218459787ns, rc = 0 00000004:00010000:0.0:1788837973.124775:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000104506f5 reply state 00000000830c21e9 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e7236 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837973.124786:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788837973.124924:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+64:11628:x1875732240363904:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 958us (1190us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1788837973.124932:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 222 00000100:00100000:3.0:1788837973.133695:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837973.133937:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240364032 00000100:00100000:0.0:1788837973.133951:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240364032 00000100:00100000:0.0:1788837973.134053:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 223 00000100:00100000:0.0:1788837973.134065:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+64:11628:x1875732240364032:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788837973.134104:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837973.134134:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e723d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d342 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.134816:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e723d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d342 expref: 65 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.134863:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e723d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d342 expref: 65 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.134892:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97a448b3c300) 00010000:00010000:0.0:1788837973.134896:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788837973.134901:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e790000, rc 0) 00000100:00100000:0.0:1788837973.134986:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+65:11628:x1875732240364032:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 922us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837973.134995:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 223 00010000:00010000:1.0:1788837973.136166:0:3257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e7236 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837973.136184:0:3257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e7236 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837973.136193:0:3257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e7236 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837973.136441:0:3257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e791600 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788837973.136449:0:3257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e7236 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837973.136459:0:3257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e7236 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837973.136482:0:3257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97a448b3c300) 00010000:00010000:1.0:1788837973.136486:0:3257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788837973.136492:0:3257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e7236 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837973.136498:0:3257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e7236 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837973.137186:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837973.137438:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240364160 00000100:00100000:0.0:1788837973.137452:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240364160 00000100:00100000:0.0:1788837973.137592:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:0.0:1788837973.137604:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b09a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+9:2351:x1875732240364160:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788837973.138030:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b09a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+10:2351:x1875732240364160:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 426us (849us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788837973.138040:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00080000:2.0:1788837973.138933:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788837973.154826:0:7971:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 353248618275ns, next at 354248596444ns, rc = 0 00000100:00100000:1.0:1788837973.154951:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788837973.154983:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255028736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837973.155617:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837973.164810:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255028736 00000100:00100000:3.0:1788837973.164836:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255028736 00000100:00100000:3.0:1788837973.164954:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788837973.164970:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3271:x1875732255028736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788837973.165044:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788837973.165179:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3271:x1875732255028736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 213us (9564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837973.165188:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1788837973.165251:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788837973.165482:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837973.169644:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255028736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837973.169645:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732255028864:0@lo:400:kworker.0 00000100:00100000:1.0:1788837973.169739:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837973.169793:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732255029376:0@lo:400:kworker.0 00000100:00100000:1.0:1788837973.169823:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837973.169856:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837973.169863:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732255028992:0@lo:400:kworker.0 00000100:00100000:1.0:1788837973.169889:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837973.169927:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255029248:0@lo:400:kworker.0 00000100:00100000:1.0:1788837973.169963:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837973.170017:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837973.170024:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3272:1875732255029120:0@lo:400:kworker.0 00000100:00100000:1.0:1788837973.170047:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837973.170082:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255028864 00000100:00100000:1.0:1788837973.170091:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255028864 00000100:00100000:1.0:1788837973.170161:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788837973.170173:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3273:x1875732255028864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837973.170261:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3273:x1875732255028864:12345-0@lo:400:kworker.0 Request processed in 91us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837973.170269:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788837973.170326:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255029376 00000100:00100000:1.0:1788837973.170330:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255029376 00000100:00100000:1.0:1788837973.170364:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255028992 00000100:00100000:1.0:1788837973.170367:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255028992 00000100:00100000:1.0:1788837973.170385:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255029120 00000100:00100000:1.0:1788837973.170387:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255029120 00000100:00100000:1.0:1788837973.170403:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788837973.170409:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1875732255029376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837973.170444:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1875732255029376:12345-0@lo:400:kworker.0 Request processed in 35us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837973.170449:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788837973.170461:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788837973.170467:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732255028992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837973.170491:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732255028992:12345-0@lo:400:kworker.0 Request processed in 25us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837973.170496:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788837973.170506:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788837973.170512:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1875732255029120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837973.170554:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1875732255029120:12345-0@lo:400:kworker.0 Request processed in 43us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837973.170560:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788837973.170595:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3272:1875732255029120:0@lo:400:kworker.0 00000100:00100000:1.0:1788837973.170632:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732255028992:0@lo:400:kworker.0 00000100:00100000:1.0:1788837973.170640:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732255028864:0@lo:400:kworker.0 00000100:00100000:1.0:1788837973.170649:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732255029376:0@lo:400:kworker.0 00000100:00080000:3.0:1788837973.171029:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837973.171048:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240364416 00000100:00100000:3.0:1788837973.171054:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240364416 00000100:00100000:3.0:1788837973.171095:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:3.0:1788837973.171104:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b0a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+64:11628:x1875732240364416:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788837973.171782:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b0a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+65:11628:x1875732240364416:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 675us (6299us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1788837973.171792:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:2.0:1788837973.172227:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255029248 00000100:00100000:2.0:1788837973.172237:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255029248 00000100:00100000:2.0:1788837973.172311:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788837973.172321:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3272:x1875732255029248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837973.172395:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3272:x1875732255029248:12345-0@lo:400:kworker.0 Request processed in 77us (2432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837973.172402:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1788837973.172432:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837973.172484:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255029248:0@lo:400:kworker.0 00000100:00100000:3.0:1788837973.177304:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837973.177664:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240364672 00000100:00100000:0.0:1788837973.177680:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240364672 00000100:00100000:0.0:1788837973.177770:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 224 00000100:00100000:0.0:1788837973.177783:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+65:11628:x1875732240364672:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788837973.177938:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+65:11628:x1875732240364672:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 157us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837973.177968:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 224 00000100:00100000:2.0:1788837973.186979:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837973.187196:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240364800 00000100:00100000:3.0:1788837973.187245:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240364800 00000100:00100000:3.0:1788837973.187332:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 225 00000100:00100000:3.0:1788837973.187407:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b09b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+65:11628:x1875732240364800:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788837973.187438:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837973.187469:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7244 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d349 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.187575:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e724b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.187610:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e724b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.187624:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e724b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837973.187681:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788837973.187705:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e724b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.187736:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7244 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d349 expref: 67 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.187756:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e724b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d349 expref: 66 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.187766:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97a448b3c300) 00010000:00010000:3.0:1788837973.187770:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788837973.187775:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48b200, rc 0) 00000100:00100000:3.0:1788837973.187860:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b09b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+66:11628:x1875732240364800:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 459us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837973.193382:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 225 00000100:00100000:3.0:1788837973.193692:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837973.195338:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240364928 00000100:00100000:2.0:1788837973.195356:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240364928 00000100:00100000:2.0:1788837973.195438:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:2.0:1788837973.195452:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+10:2351:x1875732240364928:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837973.195494:0:6653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837973.195526:0:6653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000210719c7/0x2deb895b363e7252 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d350 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788837973.195565:0:6653:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f8054, blocks: 0x1 00010000:00010000:2.0:1788837973.195592:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=353s v=(0 0) 00010000:00010000:2.0:1788837973.195597:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837973.196144:0:6653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000210719c7/0x2deb895b363e7252 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d350 expref: 11 pid: 6653 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.196177:0:6653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000210719c7/0x2deb895b363e7252 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d350 expref: 11 pid: 6653 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.196193:0:6653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4c00, rc 0) 00000100:00100000:2.0:1788837973.196349:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+11:2351:x1875732240364928:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 900us (2657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837973.196358:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:3.0:1788837973.205886:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837973.205939:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240365184 00000100:00100000:3.0:1788837973.205952:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240365184 00000100:00100000:3.0:1788837973.206019:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 226 00000100:00100000:3.0:1788837973.206031:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+66:11628:x1875732240365184:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788837973.206196:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+66:11628:x1875732240365184:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 167us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837973.206231:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 226 00000100:00100000:3.0:1788837973.216075:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837973.218332:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240365312 00000100:00100000:1.0:1788837973.218353:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240365312 00000100:00100000:1.0:1788837973.218428:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:1.0:1788837973.218440:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+11:11628:x1875732240365312:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788837973.218470:0:6652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837973.218496:0:6652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bbb5b8e/0x2deb895b363e7259 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d357 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837973.218540:0:6652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000210719c7/0x2deb895b363e7252 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d350 expref: 12 pid: 6653 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837973.218551:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837973.218555:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837973.218571:0:6652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bbb5b8e/0x2deb895b363e7259 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d357 expref: 12 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837973.218615:0:6652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000210719c7/0x2deb895b363e7252 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d350 expref: 12 pid: 6653 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837973.218644:0:6652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000210719c7/0x2deb895b363e7252 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d350 expref: 12 pid: 6653 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837973.218661:0:6652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6652:1875732255029504:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788837973.218784:0:6652:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f97b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837973.232380:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837973.232454:0:6652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6652:1875732255029504:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788837973.232523:0:6652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008bbb5b8e/0x2deb895b363e7259 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d357 expref: 12 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.232560:0:6652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3d200, rc 0) 00000100:00100000:3.0:1788837973.233452:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+12:11628:x1875732240365312:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 15008us (17389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837973.233520:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:3.0:1788837973.233577:0:7599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240365440 00000100:00100000:3.0:1788837973.233586:0:7599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240365440 00010000:00010000:3.0:1788837973.233850:0:7599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000210719c7/0x2deb895b363e7252 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d350 expref: 12 pid: 6653 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837973.233892:0:7599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00100000:3.0:1788837973.233904:0:7599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+12:2351:x1875732240365440:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837973.233922:0:7599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837973.233952:0:7599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000210719c7/0x2deb895b363e7252 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d350 expref: 12 pid: 6653 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.233968:0:7599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000210719c7/0x2deb895b363e7252 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d350 expref: 12 pid: 6653 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.234018:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000210719c7/0x2deb895b363e7252 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d350 expref: 12 pid: 6653 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.234039:0:7599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837973.234044:0:7599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837973.234054:0:7599:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008bbb5b8e/0x2deb895b363e7259 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d357 expref: 11 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.234066:0:7599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bbb5b8e/0x2deb895b363e7259 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d357 expref: 11 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.235388:0:7599:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008bbb5b8e/0x2deb895b363e7259 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d357 expref: 11 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837973.235418:0:7599:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448b76300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7599:1875732255029632:192.168.204.54@tcp:105: 00000100:00100000:3.0:1788837973.235570:0:7599:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a44a010780 going to sleep for 11 seconds 00000100:00100000:3.0:1788837973.240596:0:7599:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448b76300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7599:1875732255029632:192.168.204.54@tcp:105: 00010000:00010000:3.0:1788837973.240645:0:7599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837973.240729:0:7599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+11:2351:x1875732240365440:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 6827us (8367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837973.240742:0:7599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00100000:3.0:1788837973.242911:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837973.245353:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240365568 00000100:00100000:1.0:1788837973.245378:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240365568 00002000:00100000:1.0:1788837973.245877:0:6658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff97a448b76300 x1875732240365568/t0(0) o4->f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7@192.168.204.54@tcp:629/0 lens 504/0 e 0 to 0 dl 1788837984 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788837973.245893:0:6658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a448b76300 with x1875732240365568 ext(0->12) 00002000:00010000:1.0:1788837973.245902:0:6658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97a448b76300 00000100:00100000:1.0:1788837973.246007:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:1.0:1788837973.246023:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+11:2350:x1875732240365568:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788837973.246787:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+13:2350:x1875732240365568:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 Request processed in 764us (4021us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788837973.246797:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00002000:00100000:1.0:1788837973.246808:0:6658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff97a448b76300 x1875732240365568/t4294967320(0) o4->f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7@192.168.204.54@tcp:629/0 lens 504/448 e 0 to 0 dl 1788837984 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788837973.246818:0:6658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a448b76300 with x1875732240365568 ext(0->12) 00002000:00010000:1.0:1788837973.246823:0:6658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97a448b76300 00000001:00080000:2.0:1788837973.259818:0:7611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:2.0:1788837973.259848:0:7611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:0.0:1788837973.273665:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837973.273737:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240365696 00000100:00100000:3.0:1788837973.273752:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240365696 00000100:00100000:3.0:1788837973.273916:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 227 00000100:00100000:3.0:1788837973.273931:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b0a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+66:11628:x1875732240365696:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788837973.305831:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b0a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+66:11628:x1875732240365696:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 Request processed in 31885us (32162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837973.305848:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 227 00000001:00080000:3.0:1788837973.305903:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:3.0:1788837973.305912:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:3.0:1788837973.305965:0:5830:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:3.0:1788837973.306006:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:3.0:1788837973.306043:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1788837973.306059:0:5830:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97a4601b2780 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788837973.306063:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a458c85b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97a4601b2e40 00000020:00080000:3.0:1788837973.306066:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a458c85800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97a46e79e400 00000020:00080000:3.0:1788837973.306090:0:5830:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97a461a643c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788837973.306093:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a458c85a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97a461a64b40 00000020:00080000:3.0:1788837973.306096:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a458c85300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97a46f43f000 00000001:00080000:3.0:1788837973.306111:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1788837973.306117:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:3.0:1788837973.306152:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1788837973.306459:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788837973.307106:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837973.307133:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255029760:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788837973.307267:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837973.307375:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a450ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255029888:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788837973.307404:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837973.307448:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255029760 00000100:00100000:1.0:1788837973.307457:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255029760 00000100:00100000:1.0:1788837973.307527:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255029888 00000100:00100000:1.0:1788837973.307531:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255029888 00000100:00100000:1.0:1788837973.307559:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788837973.307570:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3273:x1875732255029760:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788837973.307603:0:6653:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00000100:00100000:3.0:1788837973.307923:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788837973.307932:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3271:x1875732255029888:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788837973.308116:0:6652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788837973.308120:0:6652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788837972 00002000:00010000:3.0:1788837973.308123:0:6652:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788837973.308137:0:6652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788837972 -> 1788837972 00002000:00010000:3.0:1788837973.308139:0:6652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788837973.308192:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3271:x1875732255029888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 261us (786us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788837973.308221:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:3.0:1788837973.308300:0:3271:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97a450ad3b80/2, rc 0, transno 4294967321 00000100:00100000:3.0:1788837973.308308:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255029888:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788837973.308319:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837973.308327:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255030016:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788837973.308362:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837973.308398:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255030016 00000100:00100000:3.0:1788837973.308402:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255030016 00000100:00100000:3.0:1788837973.308426:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788837973.308432:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255030016:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788837973.308446:0:6652:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1788837973.308479:0:6652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f8052, atime: 0x6a9f8052, ctime: 0x6a9f8052, blocks: 0xb 00010000:00010000:3.0:1788837973.308488:0:6652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb498f4b/0x2deb895b363e7260 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.308510:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1788837973.308516:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837973.308526:0:6652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb498f4b/0x2deb895b363e7260 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.308545:0:6652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb498f4b/0x2deb895b363e7260 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.308573:0:6652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb498f4b/0x2deb895b363e7260 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.308582:0:6652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb498f4b/0x2deb895b363e7260 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.308605:0:6652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788837973.309292:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3271:x1875732255030016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 847us (916us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788837973.309302:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:3.0:1788837973.309333:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837973.309341:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb498f4b/0x2deb895b363e7260 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.309353:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48aa00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:3.0:1788837973.309358:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb498f4b/0x2deb895b363e7260 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.309369:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb498f4b/0x2deb895b363e7260 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.309389:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb498f4b/0x2deb895b363e7260 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.309397:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb498f4b/0x2deb895b363e7260 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.309425:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837973.309427:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837973.309429:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837973.309456:0:3271:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1788837973.309462:0:3271:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97a46f4b8380, transno 4294967307 00000004:00080000:3.0:1788837973.309473:0:3271:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:3.0:1788837973.309504:0:3271:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff97a448b75f80 x1875732255030016/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788837989 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788837973.309515:0:3271:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97a448b75f80/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788837973.309520:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255030016:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788837973.309785:0:6653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000335b4094/0x2deb895b363e7267 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837973.309806:0:6653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e7022 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2b6 expref: 12 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837973.309815:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1788837973.309820:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837973.309825:0:6653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000335b4094/0x2deb895b363e7267 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837973.309869:0:6653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e7022 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2b6 expref: 12 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837973.309887:0:6653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e7022 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2b6 expref: 12 pid: 6653 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837973.309917:0:6653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6653:1875732255030144:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788837973.310003:0:6653:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f97300 going to sleep for 11 seconds 00000100:00100000:0.0:1788837973.312600:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837973.312798:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240365824 00000100:00100000:3.0:1788837973.312809:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240365824 00000100:00100000:3.0:1788837973.312882:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:3.0:1788837973.312894:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b0a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+13:2352:x1875732240365824:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788837973.315072:0:6653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6653:1875732255030144:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788837973.315119:0:6653:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000335b4094/0x2deb895b363e7267 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837973.321965:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837973.322729:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240365952 00000100:00100000:3.0:1788837973.322742:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240365952 00010000:00010000:3.0:1788837973.322799:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e7022 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2b6 expref: 14 pid: 6653 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837973.322856:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 82 00000100:00100000:3.0:1788837973.322869:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b0a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+14:2352:x1875732240365952:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837973.322889:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837973.322896:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e7022 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2b6 expref: 14 pid: 6653 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.322933:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e7022 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2b6 expref: 14 pid: 6653 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.322965:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013d31740/0x2deb895b363e7022 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d2b6 expref: 14 pid: 6653 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.322987:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788837973.322992:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788837973.323000:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000335b4094/0x2deb895b363e7267 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.323010:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000335b4094/0x2deb895b363e7267 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.323045:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837973.323120:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b0a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+13:2352:x1875732240365952:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 254us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837973.323129:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 82 00010000:00010000:2.0:1788837973.324633:0:6653:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000335b4094/0x2deb895b363e7267 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.324652:0:6653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000335b4094/0x2deb895b363e7267 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.324665:0:6653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000335b4094/0x2deb895b363e7267 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.324690:0:6653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000335b4094/0x2deb895b363e7267 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.324715:0:6653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788837973.325406:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3273:x1875732255029760:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17831us (18132us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788837973.325418:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:3.0:1788837973.326037:0:7597:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837973.326047:0:7597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000335b4094/0x2deb895b363e7267 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.326059:0:7597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3c800 already unused, calling callback (ffffffffc1616420) 00010000:00010000:3.0:1788837973.326065:0:7597:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000335b4094/0x2deb895b363e7267 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.326092:0:7597:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000335b4094/0x2deb895b363e7267 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.326128:0:7597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000335b4094/0x2deb895b363e7267 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.326142:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000335b4094/0x2deb895b363e7267 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.326169:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837973.326171:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837973.326173:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788837973.326383:0:3273:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97a450ad1500/2, rc 0, transno 4294967322 00000100:00100000:1.0:1788837973.326393:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a450ad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255029760:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1788837973.355045:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:2.0:1788837973.355070:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:2.0:1788837973.355094:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:1.0:1788837973.355325:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b0a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2352:x1875732240365824:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 Request processed in 42424us (42727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837973.355340:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:0.0:1788837973.358581:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837973.358756:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240366208 00000100:00100000:3.0:1788837973.358842:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240366208 00000100:00100000:3.0:1788837973.358997:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 228 00000100:00100000:3.0:1788837973.359010:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+20:11628:x1875732240366208:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788837973.359088:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837973.359136:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e724b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d349 expref: 20 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.359162:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97a448b3c300) 00010000:00010000:3.0:1788837973.359169:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788837973.359340:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e726e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.359361:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e726e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.359394:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e726e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788837973.359994:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fc78d99e reply state 00000000cbbc2c54 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e726e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837973.360008:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788837973.360328:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+21:11628:x1875732240366208:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 1318us (1760us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1788837973.360337:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 228 00000100:00100000:0.0:1788837973.364032:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837973.364653:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240366336 00000100:00100000:1.0:1788837973.364667:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240366336 00000100:00100000:1.0:1788837973.364754:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:1.0:1788837973.364926:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47d2bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2351:x1875732240366336:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788837973.365476:0:6650:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788837973.365491:0:6650:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788837972 -> 1788837971 00002000:00010000:1.0:1788837973.365493:0:6650:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788837970 00002000:00010000:1.0:1788837973.365496:0:6650:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788837972 -> 1788837971 00002000:00010000:1.0:1788837973.365498:0:6650:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788837973.365630:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47d2bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:2351:x1875732240366336:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 862us (1609us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1788837973.365638:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 69 00010000:00010000:3.0:1788837973.366537:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e726e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.366553:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e726e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.366562:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e726e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.366568:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48ba00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788837973.366594:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e726e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.366705:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e726e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.366730:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97a448b3c300) 00010000:00010000:3.0:1788837973.366733:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837973.366739:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e726e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.366845:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e726e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837973.369787:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837973.369961:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240366592 00000100:00100000:0.0:1788837973.369975:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240366592 00000100:00100000:0.0:1788837973.370062:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 229 00000100:00100000:0.0:1788837973.370074:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+20:11628:x1875732240366592:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788837973.370195:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e7275 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.370254:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e722f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d33b expref: 20 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.370265:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e7275 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.370345:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e722f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d33b expref: 20 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.370364:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e722f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d33b expref: 20 pid: 7972 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837973.370383:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5809:1875732255030272:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788837973.370498:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4600c6180 going to sleep for 11 seconds 00000100:00100000:0.0:1788837973.378084:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837973.378950:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240366720 00000100:00100000:1.0:1788837973.378966:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240366720 00010000:00010000:1.0:1788837973.379032:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e722f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d33b expref: 21 pid: 7972 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837973.379093:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 83 00000100:00100000:1.0:1788837973.379107:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+21:2351:x1875732240366720:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837973.379127:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837973.379136:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e722f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d33b expref: 21 pid: 7972 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837973.379153:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e722f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d33b expref: 21 pid: 7972 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837973.379311:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97a448b3c300) 00010000:00010000:1.0:1788837973.379318:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e7275 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837973.379342:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e7275 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837973.379351:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e7275 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837973.379379:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837973.379453:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+21:2351:x1875732240366720:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 350us (1385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837973.381087:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 83 00010000:00010000:3.0:1788837973.381602:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5600/0x2deb895b363e722f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d33b expref: 20 pid: 7972 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837973.381921:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5809:1875732255030272:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788837973.381960:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e7275 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.382104:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e7275 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.382112:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e7275 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.382151:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e7275 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.382159:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e7275 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.382168:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e7275 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.382175:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e790200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837973.382181:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e7275 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.383003:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e7275 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.383028:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97a448b3c300) 00010000:00010000:2.0:1788837973.383033:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788837973.383039:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e7275 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.383046:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790200/0x2deb895b363e7275 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837973.383311:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+19:11628:x1875732240366592:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 Request processed in 13235us (13554us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788837973.383324:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 229 00000100:00100000:0.0:1788837973.388672:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837973.389007:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240366848 00000100:00100000:2.0:1788837973.389021:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240366848 00000100:00100000:2.0:1788837973.389157:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:2.0:1788837973.389169:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:2349:x1875732240366848:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788837973.389292:0:6653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bea8b964/0x2deb895b363e727c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.389320:0:6653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008bbb5b8e/0x2deb895b363e7259 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d357 expref: 8 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.389331:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837973.389335:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788837973.389340:0:6653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bea8b964/0x2deb895b363e727c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.389402:0:6653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008bbb5b8e/0x2deb895b363e7259 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d357 expref: 8 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.389418:0:6653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008bbb5b8e/0x2deb895b363e7259 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d357 expref: 8 pid: 6652 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837973.389434:0:6653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b098e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6653:1875732255030400:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788837973.389567:0:6653:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a46e8eb900 going to sleep for 11 seconds 00000100:00100000:3.0:1788837973.392729:0:6653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b098e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6653:1875732255030400:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788837973.392797:0:6653:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bea8b964/0x2deb895b363e727c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837973.395156:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837973.395660:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240366976 00000100:00100000:3.0:1788837973.395694:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240366976 00010000:00010000:3.0:1788837973.395773:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008bbb5b8e/0x2deb895b363e7259 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d357 expref: 9 pid: 6652 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837973.395824:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 84 00000100:00100000:3.0:1788837973.395837:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f491c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+9:2352:x1875732240366976:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837973.395858:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837973.395889:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008bbb5b8e/0x2deb895b363e7259 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d357 expref: 9 pid: 6652 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.395929:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008bbb5b8e/0x2deb895b363e7259 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d357 expref: 9 pid: 6652 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.395962:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bbb5b8e/0x2deb895b363e7259 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d357 expref: 9 pid: 6652 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.395985:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788837973.395990:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788837973.395997:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bea8b964/0x2deb895b363e727c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.396009:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bea8b964/0x2deb895b363e727c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.396052:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837973.396132:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f491c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:2352:x1875732240366976:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 296us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837973.396140:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 84 00010000:00010000:0.0:1788837973.396410:0:6653:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bea8b964/0x2deb895b363e727c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.396422:0:6653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bea8b964/0x2deb895b363e727c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.396455:0:6653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bea8b964/0x2deb895b363e727c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.396475:0:6653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bea8b964/0x2deb895b363e727c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.396483:0:6653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bea8b964/0x2deb895b363e727c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.396490:0:6653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5800 already unused, calling callback (ffffffffc1616420) 00010000:00010000:0.0:1788837973.396496:0:6653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bea8b964/0x2deb895b363e727c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.396506:0:6653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bea8b964/0x2deb895b363e727c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.396519:0:6653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bea8b964/0x2deb895b363e727c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.396542:0:6653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bea8b964/0x2deb895b363e727c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837973.396611:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2349:x1875732240366848:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 Request processed in 7445us (8012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837973.396621:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:2.0:1788837973.401189:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837973.401390:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240367232 00000100:00100000:3.0:1788837973.401405:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240367232 00000100:00100000:3.0:1788837973.401505:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 230 00000100:00100000:3.0:1788837973.401517:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+19:11628:x1875732240367232:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788837973.401632:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7283 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.401656:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7283 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.401688:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7283 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.401977:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e728a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.401991:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e723d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d342 expref: 20 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.402002:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e728a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.402050:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e723d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d342 expref: 20 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.402068:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e723d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d342 expref: 20 pid: 5808 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837973.402087:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47bac1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5808:1875732255030528:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788837973.402232:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a450b87900 going to sleep for 11 seconds 00000100:00100000:1.0:1788837973.409866:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837973.410062:0:7599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240367360 00000100:00100000:2.0:1788837973.410076:0:7599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240367360 00010000:00010000:2.0:1788837973.410129:0:7599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e723d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d342 expref: 21 pid: 5808 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837973.410180:0:7599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 85 00000100:00100000:2.0:1788837973.410262:0:7599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+21:2352:x1875732240367360:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837973.410295:0:7599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837973.410303:0:7599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e723d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d342 expref: 21 pid: 5808 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.410321:0:7599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e723d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d342 expref: 21 pid: 5808 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.410351:0:7599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97a448b3c300) 00010000:00010000:2.0:1788837973.410358:0:7599:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e728a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.410382:0:7599:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e728a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.410390:0:7599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e728a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.410416:0:7599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837973.410487:0:7599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+21:2352:x1875732240367360:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 283us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837973.410496:0:7599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 85 00010000:00010000:3.0:1788837973.410958:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790000/0x2deb895b363e723d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d342 expref: 20 pid: 5808 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837973.410981:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47bac1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5808:1875732255030528:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788837973.411013:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e728a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.411025:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e728a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.411041:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e728a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788837973.411392:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1788837973.411556:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1788837973.411602:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1788837973.411696:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47bac1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5808:1875732255030656:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788837973.411779:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837973.411824:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a450b87840 going to sleep for 11 seconds 00000100:00100000:2.0:1788837973.412141:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255030656 00000100:00100000:2.0:1788837973.412150:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255030656 00000100:00100000:2.0:1788837973.412255:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788837973.412267:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5808:x1875732255030656:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788837973.412376:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5808:x1875732255030656:12345-0@lo:1000:mdt00_000.0 Request processed in 111us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837973.412384:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788837973.413247:0:5808:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1788837973.413257:0:5808:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1788837973.413295:0:5808:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97a450ad3b80, transno 4294967321 00000100:00100000:3.0:1788837973.413318:0:5808:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff97a450ad1500 x1875732255029760/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788837989 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837973.413332:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47bac1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5808:1875732255030656:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788837973.415968:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1788837973.416097:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b098000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5808:1875732255030784:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788837973.417340:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837973.417411:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a46e8eb600 going to sleep for 11 seconds 00000100:00100000:1.0:1788837973.417954:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255030784 00000100:00100000:1.0:1788837973.417968:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255030784 00000100:00100000:1.0:1788837973.418053:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788837973.418065:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5808:x1875732255030784:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788837973.418709:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5808:x1875732255030784:12345-0@lo:1000:mdt00_000.0 Request processed in 643us (1375us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788837973.418721:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788837973.419035:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b098000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5808:1875732255030784:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788837973.419095:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e728a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.419107:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e728a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.419137:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e728a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.419143:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48b200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837973.419148:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e728a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.419157:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e728a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.419186:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97a448b3c300) 00010000:00010000:2.0:1788837973.419190:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788837973.419196:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e728a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.419348:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e728a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.419395:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e71cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.419403:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e71cd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.419409:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e71cd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.419415:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3c600 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837973.419418:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e71cd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.419435:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e71cd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.419455:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58400) 00010000:00010000:2.0:1788837973.419458:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788837973.419583:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e71d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d326 expref: 23 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.419597:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e71d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d326 expref: 23 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.419617:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e71d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d326 expref: 23 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.419662:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e71d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d326 expref: 23 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837973.419677:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b09a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5808:1875732255030912:192.168.204.54@tcp:105: 00000100:00100000:2.0:1788837973.419783:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a46e8eb600 going to sleep for 11 seconds 00000100:00100000:2.0:1788837973.424823:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b09a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5808:1875732255030912:192.168.204.54@tcp:105: 00010000:00010000:2.0:1788837973.424874:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e71cd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.424888:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e71cd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.424933:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7291 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.424974:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7291 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.424990:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7291 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.425004:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7291 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.425011:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7291 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.425018:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7291 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.425025:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4400 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837973.425029:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7291 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.425037:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7291 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.425050:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58400) 00010000:00010000:2.0:1788837973.425053:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837973.425057:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7291 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.425063:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7291 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.425073:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7283 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.425085:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7283 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.425092:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7283 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.425097:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48ba00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837973.425100:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7283 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.425106:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7283 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.425115:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58400) 00010000:00010000:2.0:1788837973.425118:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788837973.425122:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7283 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.425128:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e7283 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837973.425534:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+23:11628:x1875732240367232:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 24017us (24383us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1788837973.425546:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 230 00000020:00080000:2.0:1788837973.425553:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788837973.426381:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788837973.426390:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788837973.427090:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788837973.427105:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788837973.428503:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837973.428655:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240367488 00000100:00100000:3.0:1788837973.428667:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240367488 00000100:00100000:3.0:1788837973.428734:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:3.0:1788837973.428746:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+23:11627:x1875732240367488:12345-192.168.204.54@tcp:49:lfs.0 00000100:00100000:3.0:1788837973.428932:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+23:11627:x1875732240367488:12345-192.168.204.54@tcp:49:lfs.0 Request processed in 188us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837973.428941:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:1.0:1788837973.436874:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837973.437359:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240367744 00000100:00100000:3.0:1788837973.437374:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240367744 00000100:00100000:3.0:1788837973.437474:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 231 00000100:00100000:3.0:1788837973.437487:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+23:11627:x1875732240367744:12345-192.168.204.54@tcp:58:lfs.0 00000040:00080000:3.0:1788837973.438482:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788837973.438613:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+23:11627:x1875732240367744:12345-192.168.204.54@tcp:58:lfs.0 Request processed in 1123us (1750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837973.438624:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 231 00000100:00100000:0.0:1788837973.440632:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837973.442338:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240368000 00000100:00100000:3.0:1788837973.442353:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240368000 00000100:00100000:3.0:1788837973.442429:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:3.0:1788837973.442440:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4713a9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+23:11628:x1875732240368000:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788837973.444439:0:5812:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788837973.444564:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1788837973.444635:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e7298 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.444654:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e7298 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.444666:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e7298 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.444675:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e7298 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.444683:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e7298 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.444689:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e7298 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.444809:0:7598:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837973.444826:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e7298 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.444839:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48ac00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:2.0:1788837973.444861:0:7598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e7298 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.444872:0:7598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e7298 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.444894:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97a460c5e700) 00010000:00010000:2.0:1788837973.444898:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788837973.444903:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e7298 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.444914:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837973.444915:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837973.444917:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837973.447974:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788837973.447991:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ac00/0x2deb895b363e7298 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837973.448662:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4713a9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+25:11628:x1875732240368000:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 6210us (8024us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1788837973.448678:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 62 00000020:00080000:2.0:1788837973.448687:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788837973.485012:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837973.485122:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240368128 00000100:00100000:2.0:1788837973.485132:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240368128 00000100:00100000:2.0:1788837973.485519:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 232 00000100:00100000:2.0:1788837973.485531:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+25:11630:x1875732240368128:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788837973.485560:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837973.485586:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e729f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d35e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.485658:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e72a6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.485672:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e72a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.485700:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e72a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.485716:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e72ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.485723:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e72ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.485730:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e72ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.485989:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e72b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.486001:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e71bf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d31f expref: 26 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.486009:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e72b4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.486039:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e71bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d31f expref: 26 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.486053:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e71bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d31f expref: 26 pid: 5808 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837973.486065:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b09a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5809:1875732255031040:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788837973.486170:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a46e8eb780 going to sleep for 11 seconds 00000100:00100000:1.0:1788837973.494481:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837973.495028:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b09a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5809:1875732255031040:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788837973.495059:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e72b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837973.504699:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240368384 00000100:00100000:3.0:1788837973.504718:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240368384 00000100:00100000:3.0:1788837973.504862:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:3.0:1788837973.504874:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+27:5588:x1875732240368384:12345-192.168.204.54@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788837973.505153:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+28:5588:x1875732240368384:12345-192.168.204.54@tcp:35:ldlm_bl.0 Request processed in 280us (10961us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1788837973.505161:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:0.0:1788837973.519412:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837973.519484:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240368512 00000100:00100000:3.0:1788837973.519493:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240368512 00010000:00010000:3.0:1788837973.519531:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e71bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d31f expref: 28 pid: 5808 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837973.519571:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:3.0:1788837973.519580:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+28:2351:x1875732240368512:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837973.519595:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837973.519601:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e71bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d31f expref: 28 pid: 5808 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.519615:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e71bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d31f expref: 28 pid: 5808 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.519636:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a000/0x2deb895b363e71bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d31f expref: 28 pid: 5808 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.519667:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58400) 00010000:00010000:3.0:1788837973.519671:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e72b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.519681:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e72b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.519688:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e72b4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.519717:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837973.519773:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+27:2351:x1875732240368512:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 194us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837973.519780:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 86 00010000:00010000:0.0:1788837973.519879:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e72b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.519888:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e72b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837973.519929:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788837973.519933:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788837973.519951:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e72b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.519964:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e72b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.519973:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e72a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.519979:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e72a6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.519986:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e72a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.519998:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4000 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837973.520002:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e72a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.520010:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e72a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.520019:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:0.0:1788837973.520021:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837973.520025:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e72a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.520031:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4000/0x2deb895b363e72a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.520041:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e72ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.520046:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e72ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.520052:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e72ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.520057:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5800 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788837973.520060:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e72ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.520065:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e72ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.520082:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a448b3c300) 00010000:00010000:0.0:1788837973.520084:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837973.520087:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e72ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.520094:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5800/0x2deb895b363e72ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.520123:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e729f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d35e expref: 27 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.520135:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e72b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d35e expref: 26 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.520142:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58400) 00010000:00010000:0.0:1788837973.520144:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837973.520147:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5400, rc 0) 00000100:00100000:0.0:1788837973.520178:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+26:11630:x1875732240368128:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 34651us (35178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837973.520184:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 232 00010000:00010000:1.0:1788837973.543120:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788837974.201142:0:12488:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788837974.201159:0:12488:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788837974.201321:0:12488:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788837974.201330:0:12488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788837974.218006:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837974.218059:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837974.218065:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240368768 00000100:00100000:2.0:1788837974.218082:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240368768 00000100:00100000:3.0:1788837974.218093:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240368640 00000100:00100000:1.0:1788837974.218097:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837974.218102:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240368640 00000100:00100000:1.0:1788837974.218133:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837974.218162:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 303 00000100:00100000:1.0:1788837974.218167:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837974.218179:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2349:x1875732240368640:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788837974.218229:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240369024 00000100:00100000:1.0:1788837974.218235:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240369024 00000100:00100000:2.0:1788837974.218273:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240369152 00000100:00100000:2.0:1788837974.218278:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240369152 00000100:00100000:1.0:1788837974.218297:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240368896 00000100:00100000:1.0:1788837974.218302:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240368896 00000100:00100000:3.0:1788837974.218313:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2349:x1875732240368640:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 137us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837974.218321:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 168 00000100:00100000:3.0:1788837974.218325:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 303 00000100:00100000:2.0:1788837974.218336:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+26:2350:x1875732240368768:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788837974.218340:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 79 00000100:00100000:1.0:1788837974.218352:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2350:x1875732240369024:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788837974.218388:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+26:2350:x1875732240368768:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 56us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837974.218397:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 168 00000100:00100000:1.0:1788837974.218397:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2350:x1875732240369024:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 47us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837974.218410:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 79 00000100:00100000:2.0:1788837974.218418:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 169 00000100:00100000:2.0:1788837974.218427:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a347359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2349:x1875732240369152:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788837974.218433:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:1.0:1788837974.218444:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46019d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2349:x1875732240368896:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788837974.218452:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a347359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2349:x1875732240369152:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 26us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837974.218463:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 169 00000100:00100000:1.0:1788837974.218496:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46019d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2349:x1875732240368896:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 54us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837974.218504:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00080000:1.0:1788837974.219795:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837974.219809:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1788837974.434609:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788837974.434626:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788837974.434697:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788837974.434705:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788837974.434888:0:11659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47bac1f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875732255031168:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788837974.435040:0:11659:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448ffea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837974.438170:0:11659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47bac1f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875732255031168:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788837974.447699:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837974.447900:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240369280 00000100:00100000:2.0:1788837974.447914:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240369280 00000100:00100000:2.0:1788837974.447990:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 233 00000100:00100000:2.0:1788837974.448002:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a477ec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+26:11642:x1875732240369280:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788837974.448045:0:5809:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788837974.448191:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a477ec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+26:11642:x1875732240369280:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 191us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837974.448199:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 233 00000100:00100000:1.0:1788837974.452352:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837974.452470:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240369536 00000100:00100000:2.0:1788837974.452482:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240369536 00000100:00100000:2.0:1788837974.452558:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 234 00000100:00100000:2.0:1788837974.452570:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a34735b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+26:11642:x1875732240369536:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837974.452607:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837974.452633:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e72bb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d365 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837974.452785:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e72c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837974.452805:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e72c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837974.452822:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e72c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837974.452835:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788837974.453274:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e72bb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d365 expref: 29 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837974.453298:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e72c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d365 expref: 28 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837974.453310:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58400) 00010000:00010000:2.0:1788837974.453313:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837974.453317:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4200, rc 0) 00000100:00100000:2.0:1788837974.453407:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a34735b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+28:11642:x1875732240369536:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 839us (1069us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788837974.453438:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 234 00000100:00100000:1.0:1788837974.461871:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837974.462003:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837974.462175:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240369792 00000100:00100000:2.0:1788837974.462189:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240369792 00000100:00100000:2.0:1788837974.462312:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 235 00000100:00100000:2.0:1788837974.462326:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a347358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+28:11642:x1875732240369792:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788837974.462452:0:7972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e72d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837974.462477:0:7972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e72d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837974.462492:0:7972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e72d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837974.462862:0:7972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e72d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837974.462872:0:7972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e72d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837974.462880:0:7972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e72d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837974.462887:0:7972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4600 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837974.462893:0:7972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e72d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837974.462902:0:7972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e72d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837974.462943:0:7972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58400) 00010000:00010000:2.0:1788837974.462947:0:7972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788837974.462954:0:7972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e72d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837974.462961:0:7972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4600/0x2deb895b363e72d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7972 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788837974.463311:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788837974.463318:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1788837974.463381:0:7599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240369920 00000100:00100000:3.0:1788837974.463390:0:7599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240369920 00000100:00100000:3.0:1788837974.463446:0:7599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:3.0:1788837974.463456:0:7599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f36850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+30:2352:x1875732240369920:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837974.463469:0:7599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837974.463487:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4200/0x2deb895b363e72c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d365 expref: 30 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837974.463501:0:7599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58400) 00010000:00010000:3.0:1788837974.463504:0:7599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837974.464174:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a347358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+29:11642:x1875732240369792:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 1846us (2314us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788837974.464188:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 235 00000040:00080000:0.0:1788837974.465077:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788837974.465100:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788837974.470007:0:7599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f36850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+28:2352:x1875732240369920:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 6531us (7982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837974.470027:0:7599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:0.0:1788837974.473051:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837974.473325:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240370176 00000100:00100000:2.0:1788837974.473340:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240370176 00000100:00100000:2.0:1788837974.473426:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:2.0:1788837974.473439:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a477ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+28:11642:x1875732240370176:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788837974.473979:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a477ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+29:11642:x1875732240370176:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 541us (942us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788837974.473988:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 64 00010000:00010000:3.0:1788837974.562474:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837975.588402:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788837976.242993:0:12541:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788837976.243006:0:12541:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788837976.243064:0:12541:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788837976.243071:0:12541:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788837976.469280:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837976.469519:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240370432 00000100:00100000:0.0:1788837976.469548:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240370432 00000100:00100000:0.0:1788837976.469628:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 236 00000100:00100000:0.0:1788837976.469641:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+29:11662:x1875732240370432:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788837976.469671:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837976.469697:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e72d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d36c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.469832:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e72de lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.469851:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e72de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.469866:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e72de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837976.469878:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788837976.470193:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e72d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d36c expref: 32 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.470239:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e72de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d36c expref: 31 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.470251:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58400) 00010000:00010000:0.0:1788837976.470255:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788837976.470259:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e790800, rc 0) 00000100:00080000:3.0:1788837976.470497:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837976.484162:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+31:11662:x1875732240370432:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 14508us (14882us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788837976.484180:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 236 00000100:00100000:0.0:1788837976.493851:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837976.493907:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240370560 00000100:00100000:2.0:1788837976.493922:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240370560 00000100:00100000:2.0:1788837976.493996:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 237 00000100:00100000:2.0:1788837976.494008:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a477ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+31:11662:x1875732240370560:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:2.0:1788837976.494126:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e72ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.494150:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e72ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.494185:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e72ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.494722:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e72ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.494732:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e72ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.494740:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e72ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.494746:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788837976.494751:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e72ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.494760:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e72ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.494777:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58400) 00010000:00010000:2.0:1788837976.494781:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788837976.494786:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e72ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.494792:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5200/0x2deb895b363e72ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837976.494949:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a477ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+31:11662:x1875732240370560:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 940us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837976.494958:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 237 00000040:00080000:0.0:1788837976.546576:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788837976.546590:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788837976.546630:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788837976.546639:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788837976.594265:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837976.595428:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240370688 00000100:00100000:0.0:1788837976.595447:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240370688 00000100:00100000:0.0:1788837976.595566:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:0.0:1788837976.595581:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2350:x1875732240370688:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:0.0:1788837976.595607:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837976.595640:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b25ba15/0x2deb895b363e72f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d373 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788837976.595678:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9f8053, atime: 0x6a9f8052, ctime: 0x6a9f8053, blocks: 0xb 00010000:00010000:0.0:1788837976.595710:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=356s v=(0 0) 00010000:00010000:0.0:1788837976.595716:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837976.595728:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b25ba15/0x2deb895b363e72f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d373 expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.595750:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b25ba15/0x2deb895b363e72f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d373 expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.595767:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e791000, rc 0) 00000100:00100000:0.0:1788837976.595860:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:2350:x1875732240370688:12345-192.168.204.54@tcp:101:cat.0 Request processed in 283us (1676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837976.595867:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00080000:3.0:1788837976.596051:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837976.605009:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837976.606454:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240370816 00000100:00100000:1.0:1788837976.606485:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240370816 00002000:00100000:1.0:1788837976.606601:0:6656:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff97a47bac0380 x1875732240370816/t0(0) o3->f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7@192.168.204.54@tcp:632/0 lens 488/0 e 0 to 0 dl 1788837987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788837976.606616:0:6656:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a47bac0380 with x1875732240370816 ext(0->4095) 00002000:00010000:1.0:1788837976.606623:0:6656:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97a47bac0380 00000100:00100000:1.0:1788837976.606667:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:1.0:1788837976.606681:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47bac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:2349:x1875732240370816:12345-192.168.204.54@tcp:3:cat.0 00000100:00100000:1.0:1788837976.606991:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47bac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+8:2349:x1875732240370816:12345-192.168.204.54@tcp:3:cat.0 Request processed in 314us (1997us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788837976.607001:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00002000:00100000:1.0:1788837976.607010:0:6656:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff97a47bac0380 x1875732240370816/t0(0) o3->f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7@192.168.204.54@tcp:632/0 lens 488/4536 e 0 to 0 dl 1788837987 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788837976.607049:0:6656:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a47bac0380 with x1875732240370816 ext(0->4095) 00002000:00010000:1.0:1788837976.607053:0:6656:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97a47bac0380 00010000:00010000:2.0:1788837976.611260:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837976.738540:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788837976.739293:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255031296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837976.739390:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837976.739613:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255031296 00000100:00100000:3.0:1788837976.739720:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255031296 00000100:00080000:1.0:1788837976.739795:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837976.739845:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788837976.739868:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a477ec5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3274:x1875732255031296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788837976.739916:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788837976.740022:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a477ec5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3274:x1875732255031296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837976.740030:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788837976.740120:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255031296:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788837977.634572:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837978.281620:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ec3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255031808:0@lo:400:kworker.0 00000100:00100000:1.0:1788837978.281699:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837978.281900:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b09aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732255031552:0@lo:400:kworker.0 00000100:00100000:2.0:1788837978.282008:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b09a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3274:1875732255031424:0@lo:400:kworker.0 00000100:00100000:0.0:1788837978.289991:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255031808 00000100:00100000:0.0:1788837978.290006:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255031808 00000100:00100000:0.0:1788837978.290072:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788837978.290083:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3273:x1875732255031808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837978.290234:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837978.290301:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ec3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255032064:0@lo:400:kworker.0 00000100:00100000:3.0:1788837978.290337:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837978.290361:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788837978.290369:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ead3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732255031680:0@lo:400:kworker.0 00000100:00100000:3.0:1788837978.290391:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837978.290407:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a4496e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255032192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837978.290429:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837978.290628:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255031552 00000100:00100000:3.0:1788837978.290633:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255031552 00000100:00100000:3.0:1788837978.290664:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255031680 00000100:00100000:3.0:1788837978.290667:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255031680 00000100:00100000:3.0:1788837978.290690:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788837978.290696:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732255031552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837978.290737:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732255031552:12345-0@lo:400:kworker.0 Request processed in 41us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837978.290756:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788837978.290774:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788837978.290780:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732255031680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837978.290809:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732255031680:12345-0@lo:400:kworker.0 Request processed in 30us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837978.290826:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788837978.290844:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255032192 00000100:00100000:3.0:1788837978.290847:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255032192 00000100:00100000:3.0:1788837978.290871:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788837978.290877:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3271:x1875732255032192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788837978.290904:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788837978.290936:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3271:x1875732255032192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837978.290942:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788837978.290990:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ead3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732255031680:0@lo:400:kworker.0 00000100:00100000:3.0:1788837978.292249:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a4496e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255032192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837978.292281:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b09aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732255031552:0@lo:400:kworker.0 00000100:00100000:2.0:1788837978.292673:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837978.292731:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ec3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3274:1875732255031936:0@lo:400:kworker.0 00000100:00100000:2.0:1788837978.292775:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837978.293474:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255031936 00000100:00100000:2.0:1788837978.293484:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255031936 00000100:00100000:2.0:1788837978.293545:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788837978.293555:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f47c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1875732255031936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837978.293708:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f47c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1875732255031936:12345-0@lo:400:kworker.0 Request processed in 154us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837978.293716:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788837978.293742:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255031424 00000100:00100000:2.0:1788837978.293746:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255031424 00000100:00100000:2.0:1788837978.293775:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788837978.293781:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3274:x1875732255031424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837978.294502:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3274:x1875732255031424:12345-0@lo:400:kworker.0 Request processed in 718us (1829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837978.294511:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788837978.295769:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255032064 00000100:00100000:1.0:1788837978.295781:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255032064 00000100:00100000:1.0:1788837978.295832:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788837978.295847:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3271:x1875732255032064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837978.295915:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3271:x1875732255032064:12345-0@lo:400:kworker.0 Request processed in 70us (5577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837978.295923:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1788837978.295949:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788837978.295954:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837978.295957:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837978.297141:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3273:x1875732255031808:12345-0@lo:400:kworker.0 Request processed in 7053us (15434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837978.297154:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788837978.298114:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ec3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255031808:0@lo:400:kworker.0 00000100:00100000:3.0:1788837978.298634:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ec3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255032064:0@lo:400:kworker.0 00000100:00100000:2.0:1788837978.298638:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b09a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3274:1875732255031424:0@lo:400:kworker.0 00000100:00100000:2.0:1788837978.298658:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ec3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3274:1875732255031936:0@lo:400:kworker.0 00000001:00080000:3.0:1788837978.461399:0:7611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:3.0:1788837978.658321:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788837978.881672:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1788837978.881710:0:5830:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97a450b87840 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788837978.881716:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a448e83c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97a450b879c0 00000020:00080000:3.0:1788837978.881719:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a448e83f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97a458d2a400 00000020:00080000:3.0:1788837978.881757:0:5830:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1788837978.881799:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1788837978.882001:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:3.0:1788837978.890430:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:3.0:1788837978.890448:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000100:00100000:2.0:1788837979.341882:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837979.341973:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837979.342025:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837979.342063:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837979.342112:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837979.342196:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240371072 00000100:00100000:2.0:1788837979.342231:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240371072 00000100:00100000:2.0:1788837979.342309:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240371456 00000100:00100000:2.0:1788837979.342313:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240371456 00000100:00100000:2.0:1788837979.342340:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 173 00000100:00100000:2.0:1788837979.342374:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f47ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+18:2351:x1875732240371072:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788837979.342519:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f47ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+18:2351:x1875732240371072:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 168us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837979.342529:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 173 00000100:00100000:2.0:1788837979.342552:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 174 00000100:00100000:2.0:1788837979.342562:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f47df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2352:x1875732240371456:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788837979.342589:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f47df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2352:x1875732240371456:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 30us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837979.342595:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 174 00000100:00100000:3.0:1788837979.343284:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240370944 00000100:00100000:3.0:1788837979.343292:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240370944 00000100:00100000:3.0:1788837979.343370:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 305 00000100:00100000:3.0:1788837979.343379:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2352:x1875732240370944:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788837979.343424:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2352:x1875732240370944:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 47us (1399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837979.343430:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 305 00000100:00100000:1.0:1788837979.346066:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240371328 00000100:00100000:1.0:1788837979.346085:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240371328 00000100:00100000:1.0:1788837979.346186:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240371200 00000100:00100000:1.0:1788837979.346191:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240371200 00000100:00100000:1.0:1788837979.346253:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 83 00000100:00100000:1.0:1788837979.346265:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f47f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2351:x1875732240371328:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788837979.346380:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f47f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2351:x1875732240371328:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 117us (4406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837979.346388:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 83 00000100:00100000:1.0:1788837979.346408:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 84 00000100:00100000:1.0:1788837979.346431:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f47c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2352:x1875732240371200:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788837979.346460:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f47c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2352:x1875732240371200:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 30us (4398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837979.346466:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 84 00000100:00080000:1.0:1788837979.346488:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788837979.346502:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788837979.346505:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788837979.682534:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837980.707192:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837981.730669:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837981.867728:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788837981.867780:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f47d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255032320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837981.867908:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837981.868356:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255032320 00000100:00100000:2.0:1788837981.868370:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255032320 00000100:00100000:2.0:1788837981.868442:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788837981.868452:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b09a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732255032320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837981.868493:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788837981.868643:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837981.868670:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b09a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732255032320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 214us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837981.868678:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788837981.868732:0:3274:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1788837981.868739:0:3274:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97a450ad1500, transno 4294967322 00000004:00080000:2.0:1788837981.868767:0:3274:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1788837981.868799:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f47d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255032320:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788837982.757194:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837983.035584:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837983.035699:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240371584 00000100:00100000:3.0:1788837983.036184:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240371584 00000100:00100000:2.0:1788837983.036588:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 238 00000100:00100000:2.0:1788837983.036600:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f47d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+18:11315:x1875732240371584:12345-192.168.204.54@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788837983.036725:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f47d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+18:11315:x1875732240371584:12345-192.168.204.54@tcp:60:lhsmtool_posix.0 Request processed in 127us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837983.036732:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 238 00000100:00080000:1.0:1788837983.037110:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837983.039266:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837983.039438:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240371840 00000100:00100000:2.0:1788837983.039450:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240371840 00000100:00100000:2.0:1788837983.039516:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:2.0:1788837983.039528:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+18:11315:x1875732240371840:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788837983.039967:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+19:11315:x1875732240371840:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 440us (714us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788837983.039976:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:0.0:1788837983.286254:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837983.286480:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240371968 00000100:00100000:1.0:1788837983.286495:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240371968 00000100:00100000:1.0:1788837983.286609:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 239 00000100:00100000:1.0:1788837983.286623:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cccdf85-837b-45b2-b451-6b9fb913655f+5:12114:x1875732240371968:12345-192.168.204.54@tcp:101:lsof.0 00010000:00010000:1.0:1788837983.286652:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837983.286681:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e72fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d37a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837983.286772:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e7301 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837983.286790:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e7301 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837983.286807:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e7301 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837983.286860:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788837983.286864:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788837983.286894:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e7301 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837983.286945:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d000/0x2deb895b363e72fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d37a expref: 7 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837983.286970:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e7301 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d37a expref: 6 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837983.286980:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a45487fa00) 00010000:00010000:1.0:1788837983.286984:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788837983.286988:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3c600, rc 0) 00000100:00100000:1.0:1788837983.287076:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cccdf85-837b-45b2-b451-6b9fb913655f+6:12114:x1875732240371968:12345-192.168.204.54@tcp:101:lsof.0 Request processed in 456us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837983.287084:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 239 00000100:00080000:3.0:1788837983.287346:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837983.395708:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837983.395743:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ec3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255032448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837983.395838:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837983.395983:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255032448 00000100:00100000:0.0:1788837983.395993:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255032448 00000100:00100000:0.0:1788837983.396100:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788837983.396113:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255032448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788837983.396164:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837983.396279:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255032448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837983.396287:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788837983.397556:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ec3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732255032576:0@lo:400:kworker.0 00000100:00100000:2.0:1788837983.397634:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837983.397683:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b0a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732255033088:0@lo:400:kworker.0 00000100:00100000:2.0:1788837983.397713:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837983.397743:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837983.397748:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ec3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732255032704:0@lo:400:kworker.0 00000100:00100000:2.0:1788837983.397769:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837983.397803:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255033088 00000100:00100000:2.0:1788837983.397810:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255033088 00000100:00100000:2.0:1788837983.397855:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255032704 00000100:00100000:2.0:1788837983.397876:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255032704 00000100:00100000:2.0:1788837983.397904:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788837983.397913:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f47d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1875732255033088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837983.397968:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f47d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1875732255033088:12345-0@lo:400:kworker.0 Request processed in 56us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837983.397975:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788837983.397999:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788837983.398005:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732255032704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837983.398036:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732255032704:12345-0@lo:400:kworker.0 Request processed in 31us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837983.398042:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788837983.398061:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b0a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255032960:0@lo:400:kworker.0 00000100:00100000:2.0:1788837983.398105:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837983.398126:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837983.398132:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b0a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3274:1875732255032832:0@lo:400:kworker.0 00000100:00100000:2.0:1788837983.398154:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837983.398183:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255032832 00000100:00100000:2.0:1788837983.398187:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255032832 00000100:00100000:2.0:1788837983.398521:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788837983.398531:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1875732255032832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837983.398577:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1875732255032832:12345-0@lo:400:kworker.0 Request processed in 49us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837983.398584:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788837983.398629:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b0a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3274:1875732255032832:0@lo:400:kworker.0 00000100:00100000:2.0:1788837983.398672:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ec3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732255032704:0@lo:400:kworker.0 00000100:00100000:2.0:1788837983.398695:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b0a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732255033088:0@lo:400:kworker.0 00000100:00100000:1.0:1788837983.399317:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255032960 00000100:00100000:1.0:1788837983.399326:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255032960 00000100:00100000:1.0:1788837983.399381:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788837983.399391:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732255032960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837983.399462:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732255032960:12345-0@lo:400:kworker.0 Request processed in 73us (1356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837983.399469:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1788837983.399492:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788837983.399498:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837983.399500:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837983.399530:0:3273:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788837983.399538:0:3273:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97a448b75f80, transno 4294967310 00000100:00100000:1.0:1788837983.399568:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ec3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255032448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837983.399796:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255032576 00000100:00100000:0.0:1788837983.399879:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255032576 00000100:00100000:0.0:1788837983.399923:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788837983.399931:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3271:x1875732255032576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837983.399982:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3271:x1875732255032576:12345-0@lo:400:kworker.0 Request processed in 53us (2349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837983.399988:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788837983.400047:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b0a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255032960:0@lo:400:kworker.0 00000100:00100000:2.0:1788837983.400860:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ec3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732255032576:0@lo:400:kworker.0 00010000:00010000:3.0:1788837983.778731:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788837983.957782:0:5830:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:3.0:1788837983.957823:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1788837983.957979:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1788837983.957993:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1788837984.461802:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837984.461866:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837984.461986:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240372224 00000100:00100000:3.0:1788837984.462000:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240372224 00000100:00100000:3.0:1788837984.462095:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 178 00000100:00100000:3.0:1788837984.462108:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b0a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+18:2349:x1875732240372224:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788837984.462269:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b0a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+18:2349:x1875732240372224:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 163us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837984.462278:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 178 00000100:00100000:0.0:1788837984.463113:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837984.463145:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837984.463181:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837984.463230:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240372608 00000100:00100000:0.0:1788837984.463239:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240372608 00000100:00100000:0.0:1788837984.463289:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 179 00000100:00100000:0.0:1788837984.463300:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b0a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cccdf85-837b-45b2-b451-6b9fb913655f+6:2350:x1875732240372608:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788837984.463364:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b0a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cccdf85-837b-45b2-b451-6b9fb913655f+6:2350:x1875732240372608:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 66us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837984.463372:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 179 00000100:00100000:0.0:1788837984.463409:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240372352 00000100:00100000:0.0:1788837984.463413:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240372352 00000100:00100000:0.0:1788837984.463457:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240372480 00000100:00100000:0.0:1788837984.463460:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240372480 00000100:00100000:0.0:1788837984.463487:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:0.0:1788837984.463493:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b0a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2350:x1875732240372352:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788837984.463525:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b0a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2350:x1875732240372352:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 32us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837984.463532:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:0.0:1788837984.463546:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:0.0:1788837984.463573:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b0a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2349:x1875732240372480:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788837984.463601:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b0a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2349:x1875732240372480:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 29us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837984.463607:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00080000:1.0:1788837984.463840:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788837984.463847:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837984.468564:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240372096 00000100:00100000:2.0:1788837984.468589:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240372096 00000100:00100000:2.0:1788837984.468688:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 307 00000100:00100000:2.0:1788837984.468699:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2350:x1875732240372096:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788837984.468814:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2350:x1875732240372096:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 115us (6946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837984.468822:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 307 00010000:00010000:2.0:1788837984.803232:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837985.827907:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788837986.480037:0:12742:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 23:26:24 (1788837984) 00000040:00080000:2.0:1788837986.795442:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788837986.795451:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788837986.795907:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788837986.795915:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788837986.850418:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837986.978437:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a45108e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255033216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837986.978523:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837986.978702:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255033216 00000100:00100000:2.0:1788837986.978711:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255033216 00000100:00080000:1.0:1788837986.978829:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837986.978873:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788837986.978885:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255033216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837986.978920:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837986.978992:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255033216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837986.978998:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788837986.979082:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a45108e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255033216:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788837987.874914:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837988.515344:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b09aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255033344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837988.515451:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837988.516105:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255033344 00000100:00100000:3.0:1788837988.516117:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255033344 00000100:00100000:3.0:1788837988.516241:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788837988.516376:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255033344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788837988.516427:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837988.516756:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a45108f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3274:1875732255033472:0@lo:400:kworker.0 00000100:00100000:2.0:1788837988.516823:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837988.516860:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ec3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3274:1875732255033984:0@lo:400:kworker.0 00000100:00100000:2.0:1788837988.516901:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837988.516924:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837988.516930:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ec3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255033856:0@lo:400:kworker.0 00000100:00100000:2.0:1788837988.516960:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837988.517109:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255033344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 857us (1656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837988.517119:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1788837988.517154:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837988.517422:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a45108ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732255033600:0@lo:400:kworker.0 00000100:00100000:1.0:1788837988.517471:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837988.517494:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788837988.517500:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a45108e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732255033728:0@lo:400:kworker.0 00000100:00100000:1.0:1788837988.517853:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837988.518463:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255033856 00000100:00100000:2.0:1788837988.518474:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255033856 00000100:00100000:1.0:1788837988.518677:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255033472 00000100:00100000:1.0:1788837988.518683:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255033472 00000100:00100000:1.0:1788837988.518739:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788837988.518750:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3274:x1875732255033472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837988.518815:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3274:x1875732255033472:12345-0@lo:400:kworker.0 Request processed in 69us (1992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837988.518823:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788837988.518863:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255033984 00000100:00100000:1.0:1788837988.518867:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255033984 00000100:00100000:1.0:1788837988.518898:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255033600 00000100:00100000:1.0:1788837988.518903:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255033600 00000100:00100000:1.0:1788837988.518939:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255033728 00000100:00100000:1.0:1788837988.518943:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255033728 00000100:00100000:1.0:1788837988.518956:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788837988.518962:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1875732255033984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837988.520234:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788837988.520263:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732255033856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837988.520602:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788837988.520615:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732255033600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837988.522097:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732255033856:12345-0@lo:400:kworker.0 Request processed in 1844us (5127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837988.522115:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788837988.523008:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732255033600:12345-0@lo:400:kworker.0 Request processed in 2390us (5530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837988.523022:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788837988.523061:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788837988.523077:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4601be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732255033728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837988.523145:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4601be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732255033728:12345-0@lo:400:kworker.0 Request processed in 76us (5294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837988.523152:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:3.0:1788837988.523184:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788837988.523221:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837988.525732:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a45108e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732255033728:0@lo:400:kworker.0 00000100:00100000:2.0:1788837988.525755:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a45108ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732255033600:0@lo:400:kworker.0 00000100:00100000:1.0:1788837988.526607:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1875732255033984:12345-0@lo:400:kworker.0 Request processed in 7637us (9696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837988.526622:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788837988.526745:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b09aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255033344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837988.526794:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ec3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255033856:0@lo:400:kworker.0 00000100:00100000:1.0:1788837988.526808:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a45108f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3274:1875732255033472:0@lo:400:kworker.0 00000100:00100000:1.0:1788837988.526822:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ec3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3274:1875732255033984:0@lo:400:kworker.0 00010000:00010000:2.0:1788837988.901725:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837989.595136:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837989.595224:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837989.595268:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837989.595303:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240372992 00000100:00100000:0.0:1788837989.595310:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837989.595320:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240372992 00000100:00100000:0.0:1788837989.595350:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837989.595399:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240373248 00000100:00100000:0.0:1788837989.595405:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240373248 00000100:00100000:1.0:1788837989.595410:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240373120 00000100:00100000:1.0:1788837989.595415:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240373120 00000100:00100000:0.0:1788837989.595448:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240372864 00000100:00100000:1.0:1788837989.595456:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 89 00000100:00100000:1.0:1788837989.595474:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2351:x1875732240372992:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788837989.595600:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2351:x1875732240372992:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 134us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837989.595613:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 89 00000100:00100000:1.0:1788837989.595633:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 90 00000100:00100000:0.0:1788837989.595642:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240372864 00000100:00100000:1.0:1788837989.595643:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459204380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2351:x1875732240373120:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788837989.595679:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459204380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2351:x1875732240373120:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 38us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837989.595686:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 183 00000100:00100000:0.0:1788837989.595697:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cccdf85-837b-45b2-b451-6b9fb913655f+6:2351:x1875732240373248:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788837989.595714:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 90 00000100:00100000:1.0:1788837989.595746:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 184 00000100:00100000:1.0:1788837989.595756:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a450ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+18:2351:x1875732240372864:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788837989.595792:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cccdf85-837b-45b2-b451-6b9fb913655f+6:2351:x1875732240373248:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 95us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837989.595796:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a450ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+18:2351:x1875732240372864:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 40us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837989.595807:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 183 00000100:00100000:3.0:1788837989.596046:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240372736 00000100:00100000:3.0:1788837989.596052:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240372736 00000100:00080000:2.0:1788837989.596065:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788837989.596073:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788837989.596076:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837989.596092:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 309 00000100:00100000:3.0:1788837989.596102:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2351:x1875732240372736:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788837989.596152:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+13:2351:x1875732240372736:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 46us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837989.596160:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 309 00000100:00100000:1.0:1788837989.596356:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 184 00010000:00010000:0.0:1788837989.922609:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837990.947293:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837991.641774:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837991.642934:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240373504 00000100:00100000:3.0:1788837991.642952:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240373504 00000100:00100000:3.0:1788837991.643062:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:3.0:1788837991.643077:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459207b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+18:12336:x1875732240373504:12345-192.168.204.54@tcp:35:umount.0 00000100:00080000:2.0:1788837991.643435:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837991.645066:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459207b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+19:12336:x1875732240373504:12345-192.168.204.54@tcp:35:umount.0 Request processed in 837us (2151us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788837991.645091:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:2.0:1788837991.649142:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837991.649529:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240373760 00000100:00100000:1.0:1788837991.649543:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240373760 00000100:00100000:1.0:1788837991.649630:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:1.0:1788837991.649642:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+19:12336:x1875732240373760:12345-192.168.204.54@tcp:35:umount.0 00000100:00100000:1.0:1788837991.650153:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+20:12336:x1875732240373760:12345-192.168.204.54@tcp:35:umount.0 Request processed in 513us (1026us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1788837991.650162:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:2.0:1788837991.656657:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837991.658883:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240374016 00000100:00100000:1.0:1788837991.658904:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240374016 00000100:00100000:1.0:1788837991.659030:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:1.0:1788837991.659045:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4713a8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+20:12336:x1875732240374016:12345-192.168.204.54@tcp:35:umount.0 00000100:00100000:1.0:1788837991.659466:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4713a8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+21:12336:x1875732240374016:12345-192.168.204.54@tcp:35:umount.0 Request processed in 423us (2823us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788837991.659475:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:0.0:1788837991.661938:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837991.663149:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240374272 00000100:00100000:1.0:1788837991.663167:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240374272 00000100:00100000:1.0:1788837991.663299:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:1.0:1788837991.663313:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459207800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+21:12336:x1875732240374272:12345-192.168.204.54@tcp:35:umount.0 00000100:00100000:1.0:1788837991.663822:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459207800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+22:12336:x1875732240374272:12345-192.168.204.54@tcp:35:umount.0 Request processed in 510us (1907us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1788837991.663833:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:2.0:1788837991.670602:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837991.670656:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837991.670759:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240374400 00000100:00100000:3.0:1788837991.670777:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240374400 00000100:00100000:0.0:1788837991.670834:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240374656 00000100:00100000:0.0:1788837991.670841:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240374656 00000100:00100000:3.0:1788837991.670874:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:3.0:1788837991.670890:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a409880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+14:2352:x1875732240374400:12345-192.168.204.54@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788837991.670893:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00010000:00010000:3.0:1788837991.670916:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788837991.670934:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+14:2352:x1875732240374656:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837991.670946:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837991.670955:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a46e790e00/0x2deb895b363e6379 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf05 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837991.670961:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a44a48b800/0x2deb895b363e6563 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cfd0 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837991.670983:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837991.670983:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837991.674162:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+12:2352:x1875732240374656:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 3222us (3486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837991.674182:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:3.0:1788837991.677679:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a409880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+11:2352:x1875732240374400:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 6773us (7070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837991.677696:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:0.0:1788837991.678038:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837991.678179:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837991.678335:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240374528 00000100:00100000:1.0:1788837991.678348:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240374528 00000100:00100000:1.0:1788837991.678424:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:1.0:1788837991.678435:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459204e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+11:2352:x1875732240374528:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837991.678453:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837991.678479:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a441464e00/0x2deb895b363e62df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cecd expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837991.678504:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837991.678551:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459204e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:2352:x1875732240374528:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 119us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837991.678558:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:3.0:1788837991.678841:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240374784 00000100:00100000:3.0:1788837991.678847:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240374784 00000100:00100000:3.0:1788837991.678980:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:3.0:1788837991.678989:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459206d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+5:2348:x1875732240374784:12345-192.168.204.54@tcp:9:umount.0 00000020:00000080:3.0:1788837991.679019:0:6653:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e6651 00000100:00080000:3.0:1788837991.679030:0:6653:0:(import.c:65:import_set_state_nolock()) ffff97a46e75b800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788837991.679077:0:6653:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:0.0:1788837991.679260:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788837991.679308:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837991.679843:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459206d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+2:2348:x1875732240374784:12345-192.168.204.54@tcp:9:umount.0 Request processed in 852us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837991.679853:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:0.0:1788837991.697175:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788837991.697497:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240375168 00000100:00100000:2.0:1788837991.697511:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240375168 00000100:00100000:2.0:1788837991.697617:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:2.0:1788837991.697631:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459206300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+7:2348:x1875732240375168:12345-192.168.204.54@tcp:9:umount.0 00000020:00000080:2.0:1788837991.697678:0:6682:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e68b9 00000020:00010000:2.0:1788837991.697709:0:6682:0:(genops.c:1921:obd_stale_export_put()) Put export ffff97a46e759000: total 0 00000100:00080000:2.0:1788837991.697715:0:6682:0:(import.c:65:import_set_state_nolock()) ffff97a46e75c000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788837991.697774:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:1.0:1788837991.698198:0:7598:0:(genops.c:1907:obd_stale_export_get()) Get export ffff97a46e759000: total 0 00010000:00010000:1.0:1788837991.698274:0:7598:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97a46e759000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788837991.698350:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b439227f/0x2deb895b363e6c55 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1a5 expref: 5 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837991.698392:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b25ba15/0x2deb895b363e72f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d373 expref: 4 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837991.698408:0:7598:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97a46e759000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788837991.698421:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837991.698423:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837991.698434:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837991.698674:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459206300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+2:2348:x1875732240375168:12345-192.168.204.54@tcp:9:umount.0 Request processed in 1046us (1511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837991.698683:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00080000:0.0:1788837991.698882:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837991.708088:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788837991.708273:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240376192 00000100:00100000:1.0:1788837991.708286:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240376192 00000100:00100000:1.0:1788837991.708373:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 240 00000100:00100000:1.0:1788837991.708386:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+22:2348:x1875732240376192:12345-192.168.204.54@tcp:39:umount.0 00000020:00000080:1.0:1788837991.708436:0:5809:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e62ed 00000020:00010000:1.0:1788837991.708458:0:5809:0:(genops.c:1921:obd_stale_export_put()) Put export ffff97a458cfc000: total 0 00000100:00080000:1.0:1788837991.708464:0:5809:0:(import.c:65:import_set_state_nolock()) ffff97a344920000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788837991.708493:0:5809:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:1.0:1788837991.709013:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7+21:2348:x1875732240376192:12345-192.168.204.54@tcp:39:umount.0 Request processed in 627us (938us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1788837991.709023:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 240 00000020:00010000:0.0:1788837991.709822:0:5797:0:(genops.c:1907:obd_stale_export_get()) Get export ffff97a458cfc000: total 0 00010000:00010000:0.0:1788837991.709891:0:5797:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97a458cfc000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788837991.709951:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:0.0:1788837991.709956:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788837991.709968:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e6914 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d0cc expref: 20 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837991.709992:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97a45487fd00) 00010000:00010000:0.0:1788837991.709994:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788837991.709999:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d600/0x2deb895b363e65b7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cfde expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837991.710020:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:0.0:1788837991.710042:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788837991.710047:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c000/0x2deb895b363e6fb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d29a expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837991.710063:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a460c5ed00) 00010000:00010000:0.0:1788837991.710067:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788837991.710071:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b600/0x2deb895b363e6627 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cffa expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837991.710087:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58400) 00010000:00010000:0.0:1788837991.710090:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788837991.710094:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e71d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d326 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837991.710106:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a45487f200) 00010000:00010000:0.0:1788837991.710108:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788837991.710112:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d800/0x2deb895b363e6cd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1c8 expref: 15 pid: 10730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837991.710129:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:0.0:1788837991.710131:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788837991.710135:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791a00/0x2deb895b363e6b36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d158 expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837991.710148:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a448b3cf00) 00010000:00010000:0.0:1788837991.710150:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837991.710154:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e65d3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cfe5 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837991.710185:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a45487fa00) 00010000:00010000:0.0:1788837991.710188:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788837991.710192:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3dc00/0x2deb895b363e6cb7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d1c1 expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837991.710557:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58400) 00010000:00010000:0.0:1788837991.710561:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788837991.710566:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790800/0x2deb895b363e72de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d36c expref: 11 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837991.710583:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:0.0:1788837991.710586:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837991.710589:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ca00/0x2deb895b363e6c16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d190 expref: 10 pid: 7972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837991.710603:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a448b3c900) 00010000:00010000:0.0:1788837991.710605:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788837991.710609:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e6c40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d19e expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837991.710623:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a462b58400) 00010000:00010000:0.0:1788837991.710626:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837991.710629:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5400/0x2deb895b363e72b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d35e expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837991.710644:0:5797:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97a458cfc000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1788837991.710664:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837991.710673:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837991.710676:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837991.970681:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837992.099035:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a45108e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255034112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837992.099149:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837992.099565:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255034112 00000100:00100000:0.0:1788837992.099577:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255034112 00000100:00100000:0.0:1788837992.099711:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788837992.099723:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255034112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788837992.099771:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837992.099826:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255034112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837992.099833:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1788837992.099966:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837992.100547:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a45108e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255034112:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788837992.998629:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837993.634745:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255034624:0@lo:400:kworker.0 00000100:00100000:2.0:1788837993.634823:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837993.634905:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788837993.634911:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b09aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732255034240:0@lo:400:kworker.0 00000100:00100000:2.0:1788837993.634941:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837993.634960:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732255034752:0@lo:400:kworker.0 00000100:00100000:2.0:1788837993.635004:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837993.635037:0:10730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255034752 00000100:00100000:2.0:1788837993.635044:0:10730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255034752 00000100:00100000:2.0:1788837993.635113:0:10730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788837993.635121:0:10730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1875732255034752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837993.635169:0:10730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1875732255034752:12345-0@lo:400:kworker.0 Request processed in 49us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837993.635176:0:10730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:2.0:1788837993.635225:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837993.635252:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732255034752:0@lo:400:kworker.0 00000100:00100000:3.0:1788837993.635618:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255034624 00000100:00100000:3.0:1788837993.635623:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255034624 00000100:00100000:3.0:1788837993.635664:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788837993.635671:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255034624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837993.635722:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255034624:12345-0@lo:400:kworker.0 Request processed in 52us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837993.635730:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788837993.635801:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255034624:0@lo:400:kworker.0 00000100:00100000:1.0:1788837993.635997:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732255034368:0@lo:400:kworker.0 00000100:00100000:1.0:1788837993.636033:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837993.636064:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255034880:0@lo:400:kworker.0 00000100:00100000:1.0:1788837993.636098:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837993.636118:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837993.636126:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ead3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732255034496:0@lo:400:kworker.0 00000100:00100000:1.0:1788837993.636149:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837993.636177:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255034240 00000100:00100000:1.0:1788837993.636181:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255034240 00000100:00100000:1.0:1788837993.636238:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1788837993.636245:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3271:x1875732255034240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837993.636284:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3271:x1875732255034240:12345-0@lo:400:kworker.0 Request processed in 40us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837993.636291:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1788837993.636318:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255034368 00000100:00100000:1.0:1788837993.636322:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255034368 00000100:00100000:1.0:1788837993.636345:0:7972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255034496 00000100:00100000:1.0:1788837993.636348:0:7972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255034496 00000100:00100000:1.0:1788837993.636374:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788837993.636380:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a477ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732255034368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837993.636409:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a477ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732255034368:12345-0@lo:400:kworker.0 Request processed in 30us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837993.636415:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788837993.636425:0:7972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788837993.636430:0:7972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1875732255034496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837993.636455:0:7972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1875732255034496:12345-0@lo:400:kworker.0 Request processed in 24us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837993.636460:0:7972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788837993.636477:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255034880 00000100:00100000:1.0:1788837993.636480:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255034880 00000100:00100000:1.0:1788837993.636500:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788837993.636524:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255034880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837993.636555:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255034880:12345-0@lo:400:kworker.0 Request processed in 49us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837993.636560:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788837993.636597:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ead3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732255034496:0@lo:400:kworker.0 00000100:00100000:1.0:1788837993.636605:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732255034368:0@lo:400:kworker.0 00000100:00100000:1.0:1788837993.636622:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255034880:0@lo:400:kworker.0 00000100:00080000:1.0:1788837993.636646:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788837993.636650:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837993.636917:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b09aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732255034240:0@lo:400:kworker.0 00000100:00100000:0.0:1788837993.637421:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255035008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837993.637460:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837993.639774:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255035008 00000100:00100000:3.0:1788837993.639788:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255035008 00000100:00100000:3.0:1788837993.639841:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788837993.639851:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459204700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732255035008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788837993.639886:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788837993.639975:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459204700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732255035008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (2513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837993.639981:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788837993.640036:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255035008:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1788837993.697845:0:7611:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7 00000020:00000080:0.0:1788837993.697860:0:7611:0:(genops.c:885:class_export_put()) final put ffff97a46e75e000/f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7 00000020:00000080:3.0:1788837993.697934:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a46e75e000/f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7 for lustre-OST0001 00000020:00000080:3.0:1788837993.701620:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a46e75b800 for lustre-OST0001 00010000:00010000:1.0:1788837994.022541:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837994.042866:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837994.043012:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240376320 00000100:00100000:0.0:1788837994.043023:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240376320 00000100:00100000:0.0:1788837994.043102:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:0.0:1788837994.043111:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ec3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:2351:x1875732240376320:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837994.043127:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837994.043147:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a44a48b400/0x2deb895b363e63bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf1a expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837994.043166:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837994.043304:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ec3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a92c8dcb-08c4-4855-9620-ea86c948f6f2+9:2351:x1875732240376320:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 194us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837994.043312:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:3.0:1788837994.044876:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837994.044940:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837994.045029:0:7599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240376448 00000100:00100000:0.0:1788837994.045043:0:7599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240376448 00000100:00100000:1.0:1788837994.045054:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240376576 00000100:00100000:1.0:1788837994.045075:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240376576 00000100:00100000:1.0:1788837994.045184:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:1.0:1788837994.045198:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+10:2352:x1875732240376576:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837994.045268:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837994.045295:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a44a48ae00/0x2deb895b363e655c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cfc9 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837994.045316:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837994.045382:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a92c8dcb-08c4-4855-9620-ea86c948f6f2+9:2352:x1875732240376576:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 188us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837994.045391:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:0.0:1788837994.045642:0:7599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:0.0:1788837994.045657:0:7599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a92c8dcb-08c4-4855-9620-ea86c948f6f2+8:2352:x1875732240376448:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837994.045675:0:7599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837994.045695:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a44a48a600/0x2deb895b363e63c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf44 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837994.045710:0:7599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837994.045758:0:7599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a92c8dcb-08c4-4855-9620-ea86c948f6f2+7:2352:x1875732240376448:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 107us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837994.045765:0:7599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:2.0:1788837994.062313:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788837994.062442:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240376832 00000100:00100000:0.0:1788837994.062457:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240376832 00000100:00100000:0.0:1788837994.062543:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 241 00000100:00100000:0.0:1788837994.062553:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cccdf85-837b-45b2-b451-6b9fb913655f+6:2348:x1875732240376832:12345-192.168.204.54@tcp:39:umount.0 00000020:00000080:0.0:1788837994.062595:0:5808:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e63d4 00000020:00010000:0.0:1788837994.062603:0:5808:0:(genops.c:1921:obd_stale_export_put()) Put export ffff97a448f87800: total 0 00000100:00080000:0.0:1788837994.062607:0:5808:0:(import.c:65:import_set_state_nolock()) ffff97a448f87000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788837994.062636:0:5808:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1788837994.062851:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cccdf85-837b-45b2-b451-6b9fb913655f+5:2348:x1875732240376832:12345-192.168.204.54@tcp:39:umount.0 Request processed in 299us (547us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1788837994.062859:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 241 00000020:00010000:3.0:1788837994.063436:0:5797:0:(genops.c:1907:obd_stale_export_get()) Get export ffff97a448f87800: total 0 00010000:00010000:3.0:1788837994.063492:0:5797:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97a448f87800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788837994.063529:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a45487fa00) 00010000:00010000:3.0:1788837994.063548:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788837994.063561:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3c600/0x2deb895b363e7301 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d37a expref: 4 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837994.063588:0:5797:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97a448f87800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788837994.063600:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837994.063602:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837994.063603:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788837994.066292:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837994.093456:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788837994.093556:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240377088 00000100:00100000:3.0:1788837994.093567:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240377088 00000100:00100000:3.0:1788837994.093634:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 311 00000100:00100000:3.0:1788837994.093643:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a4f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+7:2348:x1875732240377088:12345-192.168.204.54@tcp:251:umount.0 00000020:00000080:3.0:1788837994.093688:0:5802:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e62ca 00000020:00010000:3.0:1788837994.093696:0:5802:0:(genops.c:1921:obd_stale_export_put()) Put export ffff97a344925000: total 0 00000100:00080000:3.0:1788837994.093701:0:5802:0:(import.c:65:import_set_state_nolock()) ffff97a344925800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788837994.093789:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a4f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a92c8dcb-08c4-4855-9620-ea86c948f6f2+3:2348:x1875732240377088:12345-192.168.204.54@tcp:251:umount.0 Request processed in 145us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837994.093798:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 311 00000020:00010000:0.0:1788837994.093953:0:5796:0:(genops.c:1907:obd_stale_export_get()) Get export ffff97a344925000: total 0 00010000:00010000:0.0:1788837994.093970:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837994.094016:0:5796:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97a344925000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788837994.094051:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a441465a00/0x2deb895b363e6380 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0cf0c expref: 2 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837994.094076:0:5796:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97a344925000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788837994.094086:0:5796:0:(genops.c:885:class_export_put()) final put ffff97a344925000/a92c8dcb-08c4-4855-9620-ea86c948f6f2 00010000:00010000:0.0:1788837994.094105:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837994.094107:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837994.094108:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788837994.094406:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a344925000/a92c8dcb-08c4-4855-9620-ea86c948f6f2 for MGS 00000020:00000080:3.0:1788837994.094438:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a344925800 for MGS 00000001:00100000:3.0:1788837994.200982:0:5830:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1cccdf85-837b-45b2-b451-6b9fb913655f 00000001:00080000:3.0:1788837994.201000:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1788837994.201006:0:5830:0:(genops.c:885:class_export_put()) final put ffff97a448f87800/1cccdf85-837b-45b2-b451-6b9fb913655f 00000001:00100000:3.0:1788837994.201035:0:5830:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7 00000001:00080000:3.0:1788837994.201042:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1788837994.201053:0:5830:0:(genops.c:885:class_export_put()) final put ffff97a458cfc000/f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7 00000020:00000080:1.0:1788837994.201114:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a448f87800/1cccdf85-837b-45b2-b451-6b9fb913655f for lustre-MDT0000 00000020:00000080:1.0:1788837994.201182:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a458cfc000/f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7 for lustre-MDT0000 00000020:00000080:1.0:1788837994.201250:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a448f87000 for lustre-MDT0000 00000020:00000080:1.0:1788837994.201256:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a344920000 for lustre-MDT0000 00000001:00100000:2.0:1788837994.237964:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7 00000020:00000080:2.0:1788837994.237991:0:6676:0:(genops.c:885:class_export_put()) final put ffff97a46e759000/f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7 00000020:00000080:0.0:1788837994.238078:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a46e759000/f4999ad4-f206-4abb-a7a8-b1cf65f7d0f7 for lustre-OST0000 00000020:00000080:0.0:1788837994.238136:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a46e75c000 for lustre-OST0000 00010000:00010000:2.0:1788837995.045983:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788837996.003042:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788837996.003051:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788837996.006714:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1788837996.007097:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788837996.073692:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788837996.231172:0:12944:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788837996.258299:0:12944:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788837996.258362:0:12944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a458d3cc00/0x2deb895b363e634f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6356 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837996.258382:0:12944:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a458d3cc00/0x2deb895b363e634f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e6356 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837996.258410:0:12944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a458d3cc00/0x2deb895b363e634f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2deb895b363e6356 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837996.258419:0:12944:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff97a458d3cc00/0x2deb895b363e634f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2deb895b363e6356 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837996.258438:0:12944:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788837996.258445:0:12944:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788837996.258476:0:12944:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788837996.258481:0:12944:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788837996.258490:0:12944:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788837996.258521:0:12944:0:(import.c:65:import_set_state_nolock()) ffff97a47af74800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788837996.259067:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837996.259075:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a458d3cc00/0x2deb895b363e634f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2deb895b363e6356 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837996.259102:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3cc00 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:3.0:1788837996.259108:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a458d3cc00/0x2deb895b363e634f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2deb895b363e6356 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837996.259118:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a458d3cc00/0x2deb895b363e634f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x2deb895b363e6356 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837996.259127:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a458d3cc00/0x2deb895b363e634f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x2deb895b363e6356 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837996.259135:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788837996.259138:0:5797:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788837996.259142:0:5797:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788837996.259179:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a458d3cc00/0x2deb895b363e634f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2deb895b363e6356 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837996.259186:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837996.259267:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a458d3cc00/0x2deb895b363e634f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2deb895b363e6356 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837996.259276:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a458d3cc00/0x2deb895b363e634f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2deb895b363e6356 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837996.259291:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837996.259293:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837996.259296:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837996.259305:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788837996.259329:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732255035264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788837996.259420:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837996.259517:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255035264 00000100:00100000:3.0:1788837996.259524:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255035264 00000100:00100000:3.0:1788837996.259573:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788837996.259581:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448f36450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3272:x1875732255035264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788837996.259593:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837996.259609:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a46e791800/0x2deb895b363e6356 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2deb895b363e634f expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837996.259621:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837996.259653:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448f36450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:3272:x1875732255035264:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837996.259659:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788837996.259730:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732255035264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837996.260038:0:3270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b09aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3270:1875732255035136:0@lo:39:umount.0 00000100:00100000:0.0:1788837996.260071:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837996.260369:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255035136 00000100:00100000:2.0:1788837996.260375:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255035136 00000100:00100000:2.0:1788837996.260411:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788837996.260421:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459204e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3270:x1875732255035136:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788837996.260443:0:5809:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e60d9 00000100:00080000:2.0:1788837996.260451:0:5809:0:(import.c:65:import_set_state_nolock()) ffff97a44a4a6000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788837996.260510:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459204e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3270:x1875732255035136:12345-0@lo:39:umount.0 Request processed in 90us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837996.260517:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1788837996.260524:0:5809:0:(genops.c:885:class_export_put()) final put ffff97a44a4a6800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788837996.260546:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a44a4a6800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788837996.260593:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a44a4a6000 for lustre-MDT0000 00000100:00080000:2.0:1788837996.260619:0:3270:0:(import.c:65:import_set_state_nolock()) ffff97a47af74800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788837996.260628:0:3270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b09aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3270:1875732255035136:0@lo:39:umount.0 00000100:00080000:1.0:1788837996.260998:0:12944:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788837996.261001:0:12944:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788837996.261006:0:12944:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788837996.262014:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837996.262653:0:12944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441464400/0x2deb895b363e635d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6364 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837996.262668:0:12944:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441464400/0x2deb895b363e635d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e6364 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837996.262675:0:12944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441464400/0x2deb895b363e635d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x2deb895b363e6364 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837996.262681:0:12944:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff97a441464400/0x2deb895b363e635d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x2deb895b363e6364 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837996.262739:0:12944:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837996.262766:0:12944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48a800/0x2deb895b363e6284 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e628b expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837996.262772:0:12944:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48a800/0x2deb895b363e6284 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e628b expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837996.262779:0:12944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48a800/0x2deb895b363e6284 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2deb895b363e628b expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837996.262785:0:12944:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff97a44a48a800/0x2deb895b363e6284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2deb895b363e628b expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837996.268130:0:7597:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788837996.268144:0:7597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a441464400/0x2deb895b363e635d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2deb895b363e6364 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837996.268156:0:7597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441464400 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:2.0:1788837996.268160:0:7597:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a441464400/0x2deb895b363e635d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2deb895b363e6364 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837996.268192:0:7597:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a441464400/0x2deb895b363e635d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x2deb895b363e6364 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837996.268198:0:7597:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a441464400/0x2deb895b363e635d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x2deb895b363e6364 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837996.268494:0:7597:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788837996.268497:0:7597:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788837996.268540:0:7597:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a441464400/0x2deb895b363e635d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2deb895b363e6364 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837996.268548:0:7597:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788837996.268583:0:7597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a441464400/0x2deb895b363e635d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2deb895b363e6364 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837996.268590:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a441464400/0x2deb895b363e635d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2deb895b363e6364 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837996.268603:0:7597:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837996.268607:0:7597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a44a48a800/0x2deb895b363e6284 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2deb895b363e628b expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837996.268613:0:7597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48a800 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:2.0:1788837996.268616:0:7597:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a44a48a800/0x2deb895b363e6284 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2deb895b363e628b expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837996.268623:0:7597:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a44a48a800/0x2deb895b363e6284 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2deb895b363e628b expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837996.268629:0:7597:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a44a48a800/0x2deb895b363e6284 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2deb895b363e628b expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837996.268640:0:7597:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788837996.268643:0:7597:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1788837996.268655:0:7597:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a44a48a800/0x2deb895b363e6284 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2deb895b363e628b expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837996.268661:0:7597:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788837996.268678:0:7597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a44a48a800/0x2deb895b363e6284 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2deb895b363e628b expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837996.268685:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837996.268687:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837996.268689:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837996.268708:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732255035520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837996.268779:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837996.268859:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255035520 00000100:00100000:2.0:1788837996.268867:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255035520 00000100:00100000:0.0:1788837996.268973:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837996.268985:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732255035392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837996.269016:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837996.269044:0:7599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255035392 00000100:00100000:0.0:1788837996.269047:0:7599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255035392 00000100:00100000:0.0:1788837996.269099:0:7599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788837996.269108:0:7599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a459207b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e394dacb-3a10-4fe7-bf6d-0294b37a120d+19:3271:x1875732255035392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837996.269121:0:7599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837996.269134:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a458d3da00/0x2deb895b363e6364 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2deb895b363e635d expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837996.269148:0:7599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837996.269179:0:7599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a459207b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e394dacb-3a10-4fe7-bf6d-0294b37a120d+18:3271:x1875732255035392:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837996.269192:0:7599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788837996.269262:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732255035392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837996.269732:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788837996.269742:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:3273:x1875732255035520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788837996.269750:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837996.269760:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a441667c00/0x2deb895b363e628b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2deb895b363e6284 expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837996.269774:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837996.269814:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:3273:x1875732255035520:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837996.269820:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788837996.270475:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732255035520:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788837996.273005:0:12944:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788837996.273020:0:12944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a44a48a800/0x2deb895b363e6284 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2deb895b363e628b expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837996.273046:0:12944:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788837996.273168:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837996.273184:0:12944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48bc00/0x2deb895b363e6586 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e658d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837996.273193:0:12944:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48bc00/0x2deb895b363e6586 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e658d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837996.273236:0:12944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48bc00/0x2deb895b363e6586 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2deb895b363e658d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837996.273244:0:12944:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff97a44a48bc00/0x2deb895b363e6586 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2deb895b363e658d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837996.273272:0:12944:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837996.273279:0:12944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441667600/0x2deb895b363e6038 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e603f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837996.273286:0:12944:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441667600/0x2deb895b363e6038 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e603f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837996.273293:0:12944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441667600/0x2deb895b363e6038 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2deb895b363e603f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837996.273300:0:12944:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff97a441667600/0x2deb895b363e6038 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2deb895b363e603f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837996.273332:0:12944:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788837996.273336:0:12944:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788837996.273339:0:12944:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1788837996.273377:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788837996.273383:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a44a48bc00/0x2deb895b363e6586 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2deb895b363e658d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837996.273396:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48bc00 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:0.0:1788837996.273399:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a44a48bc00/0x2deb895b363e6586 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2deb895b363e658d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837996.273409:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a44a48bc00/0x2deb895b363e6586 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2deb895b363e658d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837996.273417:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a44a48bc00/0x2deb895b363e6586 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2deb895b363e658d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837996.273424:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788837996.273426:0:5796:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788837996.273429:0:5796:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788837996.273476:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a44a48bc00/0x2deb895b363e6586 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2deb895b363e658d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837996.273483:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837996.273505:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837996.273509:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a44a48bc00/0x2deb895b363e6586 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2deb895b363e658d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837996.273510:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a441667600/0x2deb895b363e6038 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2deb895b363e603f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837996.273516:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a44a48bc00/0x2deb895b363e6586 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2deb895b363e658d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837996.273518:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441667600 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:1.0:1788837996.273521:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a441667600/0x2deb895b363e6038 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2deb895b363e603f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837996.273528:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a441667600/0x2deb895b363e6038 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2deb895b363e603f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837996.273534:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a441667600/0x2deb895b363e6038 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2deb895b363e603f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837996.273536:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837996.273538:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837996.273540:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837996.273548:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 10000000:01000000:1.0:1788837996.273549:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788837996.273551:0:5797:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788837996.273553:0:5797:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788837996.273566:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a441667600/0x2deb895b363e6038 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2deb895b363e603f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837996.273568:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732255035648:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788837996.273572:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837996.273586:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a441667600/0x2deb895b363e6038 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2deb895b363e603f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837996.273591:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a441667600/0x2deb895b363e6038 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2deb895b363e603f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837996.273602:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837996.273604:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837996.273605:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837996.273614:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732255035776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837996.273648:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1788837996.273719:0:12944:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788837996.273724:0:12944:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788837996.273728:0:12944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788837996.273733:0:12944:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788837996.273738:0:12944:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff97a458cfa000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788837996.273743:0:12944:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff97a461925000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788837996.273748:0:12944:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff97a46f4dcd28) has exports, disconnecting them 00000020:00080000:0.0:1788837996.273753:0:12944:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97a458cfa000), last request at 1788837993 00000020:00000080:0.0:1788837996.273760:0:12944:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e624c 00000100:00080000:0.0:1788837996.273776:0:12944:0:(import.c:65:import_set_state_nolock()) ffff97a458cf9800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788837996.273816:0:12944:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff97a458cfa000): rc 0 00000020:00000080:0.0:1788837996.273819:0:12944:0:(genops.c:885:class_export_put()) final put ffff97a458cfa000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:2.0:1788837996.273912:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837996.274071:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837996.274124:0:7599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255035648 00000100:00100000:1.0:1788837996.274132:0:7599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255035648 00000100:00100000:1.0:1788837996.274178:0:7599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255035776 00000100:00100000:1.0:1788837996.274181:0:7599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255035776 00000020:00080000:0.0:1788837996.274376:0:12944:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97a461925000), last request at 1788837993 00000020:00000080:0.0:1788837996.274382:0:12944:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e6181 00000100:00080000:0.0:1788837996.274388:0:12944:0:(import.c:65:import_set_state_nolock()) ffff97a461927000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788837996.274401:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788837996.274409:0:12944:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff97a461925000): rc 0 00000020:00000080:0.0:1788837996.274411:0:12944:0:(genops.c:885:class_export_put()) final put ffff97a461925000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1788837996.274419:0:12944:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbcc2817f3ae0 00000100:00080000:0.0:1788837996.274441:0:12944:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788837996.274444:0:12944:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1788837996.274463:0:12944:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:3.0:1788837996.274490:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a458cfa000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00080000:0.0:1788837996.274519:0:12944:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788837996.274534:0:12944:0:(import.c:65:import_set_state_nolock()) ffff97a47b5aa000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788837996.274548:0:12944:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788837996.274550:0:12944:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1788837996.274559:0:12944:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788837996.274622:0:12944:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788837996.274631:0:12944:0:(import.c:65:import_set_state_nolock()) ffff97a3451f0800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788837996.274666:0:12944:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff97a46f4dcd28) has no exports 00000020:00000080:3.0:1788837996.274806:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a461925000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788837996.274849:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a458cf9800 for lustre-MDT0000 00000020:00000080:3.0:1788837996.274856:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a461927000 for lustre-MDT0000 00000100:00100000:1.0:1788837996.276637:0:7599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788837996.276660:0:7599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e394dacb-3a10-4fe7-bf6d-0294b37a120d+17:3273:x1875732255035648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788837996.276678:0:7599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837996.276699:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a46e791200/0x2deb895b363e658d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2deb895b363e6586 expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837996.276714:0:7599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837996.276908:0:7599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e394dacb-3a10-4fe7-bf6d-0294b37a120d+16:3273:x1875732255035648:12345-0@lo:103:ldlm_bl.0 Request processed in 259us (3259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837996.276916:0:7599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788837996.276938:0:7599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788837996.276945:0:7599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b09aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e394dacb-3a10-4fe7-bf6d-0294b37a120d+15:3271:x1875732255035776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788837996.276953:0:7599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837996.276963:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a441521400/0x2deb895b363e603f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2deb895b363e6038 expref: 15 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837996.276975:0:7599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837996.277004:0:7599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b09aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e394dacb-3a10-4fe7-bf6d-0294b37a120d+14:3271:x1875732255035776:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (2933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837996.277010:0:7599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788837996.277240:0:3270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3270:1875732255035904:0@lo:9:umount.0 00000100:00100000:2.0:1788837996.277293:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837996.277325:0:3270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3270:1875732255036032:0@lo:9:umount.0 00000100:00100000:2.0:1788837996.277346:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837996.277381:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255035904 00000100:00100000:2.0:1788837996.277388:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255035904 00000100:00100000:2.0:1788837996.277434:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255036032 00000100:00100000:2.0:1788837996.277438:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255036032 00000100:00100000:2.0:1788837996.277464:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788837996.277471:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3270:x1875732255035904:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788837996.277500:0:6650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e61dc 00000100:00080000:2.0:1788837996.277509:0:6650:0:(import.c:65:import_set_state_nolock()) ffff97a458c4b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788837996.277546:0:6650:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1788837996.277905:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3270:x1875732255035904:12345-0@lo:9:umount.0 Request processed in 433us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837996.277913:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788837996.277927:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788837996.277935:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3270:x1875732255036032:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788837996.277948:0:6650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e62b5 00000100:00080000:2.0:1788837996.277952:0:6650:0:(import.c:65:import_set_state_nolock()) ffff97a458cfe000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788837996.277972:0:6650:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1788837996.278159:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3270:x1875732255036032:12345-0@lo:9:umount.0 Request processed in 226us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837996.278165:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788837996.278184:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788837996.278189:0:5804:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788837996.278224:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788837996.278252:0:3270:0:(import.c:65:import_set_state_nolock()) ffff97a47b5aa000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788837996.278263:0:3270:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788837996.278273:0:3270:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788837996.278276:0:3270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3270:1875732255035904:0@lo:9:umount.0 00000100:00080000:2.0:1788837996.278289:0:3270:0:(import.c:65:import_set_state_nolock()) ffff97a3451f0800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788837996.278298:0:3270:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788837996.278300:0:3270:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788837996.278302:0:3270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3270:1875732255036032:0@lo:9:umount.0 00010000:00010000:2.0:1788837996.278339:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837996.281450:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3273:1875732255035648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837996.281627:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732255035776:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788837996.296656:0:12944:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff97a46f4dcd28) has no exports 00000020:00000080:0.0:1788837996.376573:0:12944:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e6093 00000020:00000080:0.0:1788837996.376592:0:12944:0:(genops.c:885:class_export_put()) final put ffff97a47af55000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788837996.376615:0:12944:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788837996.377073:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a47af55000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788837996.377187:0:12944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788837996.377198:0:12944:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788837996.377235:0:12944:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff97a448f3b370) has no exports 00000020:00000080:1.0:1788837996.377626:0:12944:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e608c 00000020:00000080:1.0:1788837996.377633:0:12944:0:(genops.c:885:class_export_put()) final put ffff97a4712ef800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788837996.377685:0:12944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788837996.377693:0:12944:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788837996.377695:0:12944:0:(genops.c:885:class_export_put()) final put ffff97a47af75000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788837996.377697:0:12944:0:(genops.c:844:class_export_destroy()) destroying export ffff97a47af75000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788837996.377704:0:12944:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1788837996.377861:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a4712ef800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788837996.377907:0:12944:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97a45144df00 - data ffff97a45dc5b000/ffff97a47b645800 00000020:01000000:1.0:1788837996.378036:0:12944:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97a44976ec60 - data ffff97a45dc630d8/ffff97a47b52a000 00000001:00000004:1.0:1788837996.398589:0:12944:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:1.0:1788837996.520980:0:12944:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788837996.520990:0:12944:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:1.0:1788837996.521003:0:12944:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788837996.521021:0:12944:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788837996.521816:0:6679:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788837996.521824:0:6679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1788837996.521845:0:6679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788837996.523191:0:12944:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788837996.523199:0:12944:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:1.0:1788837996.523244:0:12944:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788837996.523247:0:12944:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788837996.525674:0:7968:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788837996.525682:0:7968:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1788837996.525696:0:7968:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788837996.608389:0:12944:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e605b 00000020:00000080:3.0:1788837996.608403:0:12944:0:(genops.c:885:class_export_put()) final put ffff97a46f4c9800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788837996.609333:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a46f4c9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788837996.609942:0:12944:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e6070 00000020:00000080:3.0:1788837996.609952:0:12944:0:(genops.c:885:class_export_put()) final put ffff97a46f4f5800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788837996.612916:0:12944:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788837996.612931:0:12944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837996.612942:0:12944:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788837996.612948:0:12944:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff97a46f4db370) has no exports 00000004:01000000:3.0:1788837996.613152:0:12944:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788837996.613163:0:12944:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e62ae 00000020:00000080:3.0:1788837996.613172:0:12944:0:(genops.c:885:class_export_put()) final put ffff97a344923000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788837996.617175:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a46f4f5800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788837996.617576:0:12944:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788837996.617588:0:12944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837996.617602:0:12944:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788837996.617607:0:12944:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff97a46e6a0000) has no exports 00000020:00000080:3.0:1788837996.617618:0:12944:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e62a7 00000020:00000080:3.0:1788837996.617626:0:12944:0:(genops.c:885:class_export_put()) final put ffff97a3451f3000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788837996.618110:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a344923000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788837996.618126:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a3451f3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788837996.618344:0:12944:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788837996.618349:0:12944:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788837996.618353:0:12944:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1788837996.618360:0:12944:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788837996.618362:0:12944:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788837996.618404:0:12944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788837996.618414:0:12944:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788837996.618421:0:12944:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e61c7 00000020:00000080:3.0:1788837996.618428:0:12944:0:(genops.c:885:class_export_put()) final put ffff97a3451f6000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788837996.618433:0:12944:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788837996.618438:0:12944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837996.618442:0:12944:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788837996.618445:0:12944:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff97a46ec63370) has no exports 00000020:00000080:3.0:1788837996.618449:0:12944:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e61c0 00000020:00000080:3.0:1788837996.618452:0:12944:0:(genops.c:885:class_export_put()) final put ffff97a47b5aa800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788837996.618814:0:12944:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788837996.618818:0:12944:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788837996.618821:0:12944:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1788837996.618825:0:12944:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788837996.618850:0:12944:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788837996.618875:0:12944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788837996.618881:0:12944:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788837996.618908:0:12944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788837996.618912:0:12944:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788837996.618915:0:12944:0:(genops.c:885:class_export_put()) final put ffff97a46f4cd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788837996.618918:0:12944:0:(genops.c:844:class_export_destroy()) destroying export ffff97a46f4cd000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788837996.618924:0:12944:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788837996.620320:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a3451f0800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788837996.620334:0:36:0:(genops.c:885:class_export_put()) final put ffff97a44a418000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788837996.620337:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a44a418000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788837996.620344:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788837996.620413:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a3451f6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788837996.620419:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a47b5aa800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788837996.620424:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a47b5aa000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788837996.620428:0:36:0:(genops.c:885:class_export_put()) final put ffff97a344b35800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788837996.620430:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a344b35800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788837996.620434:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788837996.620662:0:12944:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e6077 00000020:00000080:3.0:1788837996.620671:0:12944:0:(genops.c:885:class_export_put()) final put ffff97a46f4f0800/lustre-MDD0000_UUID 00000020:01000000:3.0:1788837996.620692:0:12944:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788837996.620697:0:12944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837996.620705:0:12944:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788837996.620709:0:12944:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff97a46f4d8000) has no exports 00000020:00000080:3.0:1788837996.620734:0:12944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788837996.620740:0:12944:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788837996.620743:0:12944:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e607e 00000020:00000080:3.0:1788837996.620748:0:12944:0:(genops.c:885:class_export_put()) final put ffff97a46f4f3800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788837996.620758:0:12944:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97a448c63800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788837996.620762:0:12944:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a448c63800 3 00000020:01000004:3.0:1788837996.620765:0:12944:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97a448c63800 from lustre-MDT0000 00000020:00000080:3.0:1788837996.620791:0:12944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788837996.620794:0:12944:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788837996.620797:0:12944:0:(genops.c:885:class_export_put()) final put ffff97a46f4ca000/lustre-MDT0000_UUID 00000020:00000080:3.0:1788837996.620799:0:12944:0:(genops.c:844:class_export_destroy()) destroying export ffff97a46f4ca000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788837996.620808:0:12944:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788837996.620850:0:12944:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1788837996.620853:0:12944:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788837996.620856:0:12944:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788837996.620859:0:12944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837996.620861:0:12944:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788837996.620869:0:12944:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff97a4474f1000 e394dacb-3a10-4fe7-bf6d-0294b37a120d 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788837996.620874:0:12944:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff97a448f38000) has exports, disconnecting them 00000020:00080000:3.0:1788837996.620895:0:12944:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff97a4474f1000), last request at 1788837750 00000020:00000080:3.0:1788837996.620912:0:12944:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e601c 00000020:00010000:3.0:1788837996.620916:0:12944:0:(genops.c:1921:obd_stale_export_put()) Put export ffff97a4474f1000: total 2 00000100:00080000:3.0:1788837996.620920:0:12944:0:(import.c:65:import_set_state_nolock()) ffff97a4474f0000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788837996.620937:0:12944:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff97a4474f1000): rc 0 00000020:00080000:3.0:1788837996.620941:0:12944:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff97a448f38000) has no exports 00000100:00100000:1.0:1788837996.621176:0:5803:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff97a447560400:5803] 2 exiting: rc = 0 00000020:00000080:1.0:1788837996.621295:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a46f4f0800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788837996.621299:0:36:0:(genops.c:885:class_export_put()) final put ffff97a46f4ce000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788837996.621301:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a46f4ce000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788837996.621305:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788837996.621510:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a46f4f3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:2.0:1788837996.621648:0:7597:0:(genops.c:1907:obd_stale_export_get()) Get export ffff97a4474f1000: total 0 00010000:00010000:2.0:1788837996.621682:0:7597:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97a4474f1000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1788837996.621717:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a441465800/0x2deb895b363e6372 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2deb895b363e636b expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837996.621736:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a47bbb5000/0x2deb895b363e6571 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2deb895b363e656a expref: 8 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837996.621748:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a458d3c200/0x2deb895b363e657f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2deb895b363e6578 expref: 7 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837996.621763:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a441666400/0x2deb895b363e6134 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2deb895b363e612d expref: 6 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837996.621777:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a441464a00/0x2deb895b363e631e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2deb895b363e6317 expref: 5 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837996.621788:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a441465600/0x2deb895b363e632c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2deb895b363e6325 expref: 4 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837996.621798:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a441464c00/0x2deb895b363e6348 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2deb895b363e6341 expref: 3 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837996.621820:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a441464000/0x2deb895b363e633a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2deb895b363e6333 expref: 2 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837996.621842:0:7597:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97a4474f1000, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1788837996.621856:0:7597:0:(genops.c:885:class_export_put()) final put ffff97a4474f1000/e394dacb-3a10-4fe7-bf6d-0294b37a120d 00010000:00010000:2.0:1788837996.621866:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837996.621868:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837996.621870:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837996.621954:0:5802:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff97a4470ae600:5802] 1 exiting: rc = 0 00000100:00100000:3.0:1788837996.622383:0:5800:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff97a4470ae800:5800] 0 exiting: rc = 1 00000100:00100000:2.0:1788837996.622704:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622712:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622718:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622724:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622731:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622736:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622743:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622749:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622755:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622761:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622766:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622771:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622778:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622785:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622790:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622797:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622802:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622808:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622813:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622818:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622824:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622839:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622846:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622852:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622867:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622875:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622882:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622887:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622892:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622897:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622902:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622907:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622912:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622917:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622922:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622927:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622932:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622937:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622943:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622949:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622953:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622958:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622964:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622969:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622975:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622981:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622987:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622992:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.622996:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.623002:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.623007:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.623011:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.623027:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.623032:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.623037:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.623041:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.623046:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.623051:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.623056:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.623068:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.623074:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.623079:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.623093:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.623100:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788837996.624341:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a4474f1000/e394dacb-3a10-4fe7-bf6d-0294b37a120d for MGS 00000020:00000080:1.0:1788837996.624390:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a4474f0000 for MGS 20000000:01000000:3.0:1788837996.624844:0:12944:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788837996.624848:0:12944:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1788837996.625849:0:12944:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97a45144dde0 - data ffff97a45dc5b5e8/ffff97a47b645000 00000020:01000000:3.0:1788837996.625953:0:12944:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97a46712c8a0 - data ffff97a45dc38af8/ffff97a44a5f7000 00000020:00000080:3.0:1788837996.626819:0:12944:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e6000 00000020:00000080:3.0:1788837996.626827:0:12944:0:(genops.c:885:class_export_put()) final put ffff97a4474f2800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788837996.626900:0:12944:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97a448c63800 from MGS, refs=2 00000020:01000004:3.0:1788837996.626904:0:12944:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a448c63800 2 00000020:01000004:3.0:1788837996.626908:0:12944:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97a448c63800 from MGS 00000020:00000080:3.0:1788837996.626932:0:12944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788837996.626939:0:12944:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788837996.626942:0:12944:0:(genops.c:885:class_export_put()) final put ffff97a451209800/MGS 00000020:00000080:3.0:1788837996.626944:0:12944:0:(genops.c:844:class_export_destroy()) destroying export ffff97a451209800/MGS for MGS 00000020:01000000:3.0:1788837996.626951:0:12944:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788837996.627008:0:12944:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788837996.627021:0:12944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837996.627027:0:12944:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788837996.627034:0:12944:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff97a47a59b000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788837996.627040:0:12944:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff97a46e6a19b8) has exports, disconnecting them 00000020:00080000:3.0:1788837996.627045:0:12944:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff97a47a59b000), last request at 1788837751 00000020:00000080:3.0:1788837996.627050:0:12944:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e60cb 00000020:00080000:3.0:1788837996.627056:0:12944:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff97a47a59b000): rc 0 00000020:00000080:3.0:1788837996.627075:0:12944:0:(genops.c:885:class_export_put()) final put ffff97a47a59b000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788837996.633501:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a4474f2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788837996.640121:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a47a59b000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788837996.640853:0:12944:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788837996.640859:0:12944:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788837996.640862:0:12944:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788837996.640868:0:12944:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788837996.641166:0:12944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788837996.641176:0:12944:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788837996.641183:0:12944:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a448c63800 1 00000020:00000080:3.0:1788837996.641189:0:12944:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e5ff2 00000020:00000080:3.0:1788837996.641197:0:12944:0:(genops.c:885:class_export_put()) final put ffff97a450b5e000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788837996.642987:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a47af74800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788837996.643004:0:8:0:(genops.c:885:class_export_put()) final put ffff97a47d1bf800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788837996.643007:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a47d1bf800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788837996.643024:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:3.0:1788837996.643599:0:12944:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788837996.643734:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a450b5e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788837996.643749:0:12944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788837996.643757:0:12944:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788837996.643762:0:12944:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff97a448f3cd28) has no exports 00000020:00000080:2.0:1788837996.695040:0:12944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788837996.695058:0:12944:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788837996.695065:0:12944:0:(genops.c:885:class_export_put()) final put ffff97a451209000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788837996.695070:0:12944:0:(genops.c:844:class_export_destroy()) destroying export ffff97a451209000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788837996.695081:0:12944:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788837996.695277:0:12944:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97a448c61800 00000020:01000000:2.0:1788837996.695309:0:12944:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788837996.695314:0:12944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788837996.695319:0:12944:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788837996.695325:0:12944:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff97a4592099b8) has no exports 00000100:00100000:2.0:1788837996.695429:0:7972:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff97a447674400:7972] 3 exiting: rc = 0 00000100:00100000:2.0:1788837996.695554:0:5809:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff97a44a5a2e00:5809] 1 exiting: rc = 0 00000100:00100000:0.0:1788837996.698582:0:5808:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff97a459202a00:5808] 0 exiting: rc = 1 00000100:00100000:1.0:1788837996.699071:0:10730:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff97a46e755c00:10730] 4 exiting: rc = 0 00000100:00100000:3.0:1788837996.733518:0:5810:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff97a44a5f3e00:5810] 2 exiting: rc = 0 00000100:00100000:1.0:1788837996.733687:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733696:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733714:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733720:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733726:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733732:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733738:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733744:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733749:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733755:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733760:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733766:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733772:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733778:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733783:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733788:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733794:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733799:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733819:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733826:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733844:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733851:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733857:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733863:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733869:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733876:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733883:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733888:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733894:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733901:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733906:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733912:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733918:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733923:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733930:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733936:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733941:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733955:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733961:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733966:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733971:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733976:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733981:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733986:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733991:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.733997:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.734004:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.734009:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.734409:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.734415:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.734421:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.734426:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.734432:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.734437:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.734442:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.734447:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.734452:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.734458:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.734463:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.734468:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.734475:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.734481:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.734486:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.734501:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.740440:0:5812:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff97a44a5a2a00:5812] 1 exiting: rc = 0 00000100:00100000:3.0:1788837996.741714:0:5811:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff97a44a5a2c00:5811] 0 exiting: rc = 1 00000100:00100000:1.0:1788837996.742174:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742184:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742190:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742196:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742311:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742318:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742325:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742341:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742347:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742355:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742360:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742369:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742376:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742382:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742387:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742392:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742397:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742403:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742408:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742413:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742419:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742424:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742431:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742436:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742440:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742445:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742451:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742456:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742461:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742467:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742472:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742477:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742481:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742486:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742492:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742496:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742502:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742508:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742513:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742518:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742524:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742529:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742543:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742548:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742554:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742559:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742564:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742569:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742575:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742580:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742585:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742589:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742594:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742600:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742605:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742610:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742615:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742620:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742625:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742630:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742635:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742640:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742645:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.742649:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837996.743777:0:5814:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff97a44a5c8000:5814] 1 exiting: rc = 0 00000100:00100000:2.0:1788837996.743958:0:5813:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff97a44a5c9000:5813] 0 exiting: rc = 1 00000100:00100000:1.0:1788837996.744110:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744119:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744126:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744134:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744140:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744148:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744155:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744161:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744181:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744189:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744196:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744339:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744347:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744365:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744372:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744378:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744384:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744390:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744397:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744404:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744421:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744427:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744433:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744439:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744445:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744451:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744456:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744462:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744467:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744473:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744478:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744484:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744500:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744506:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744511:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744517:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744522:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744528:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744533:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744539:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744545:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744550:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744556:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744562:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744580:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744586:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744591:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744597:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744609:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744614:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744621:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744627:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744632:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744638:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744644:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744650:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744669:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744676:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744682:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744688:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744694:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744700:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744706:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.744712:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837996.756033:0:5815:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff97a44a5d0a00:5815] 0 exiting: rc = 1 00000100:00100000:2.0:1788837996.756632:0:5816:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff97a44a4af200:5816] 1 exiting: rc = 0 00000100:00100000:1.0:1788837996.756795:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756802:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756808:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756814:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756819:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756824:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756840:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756846:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756851:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756856:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756861:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756866:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756871:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756883:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756888:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756893:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756898:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756903:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756908:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756925:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756929:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756934:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756940:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756944:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756950:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756955:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756959:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756964:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756969:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756974:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756978:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756984:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756988:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756993:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.756997:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.757002:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.757007:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.757019:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.757024:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.757029:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.757033:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.757038:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.757044:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.757049:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.757053:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.757058:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.757064:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.757068:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.757073:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.757078:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.757082:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.757087:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.757091:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.757095:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.757105:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.757110:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.757115:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.757120:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.757125:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.757129:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.757135:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.757139:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.757143:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.757148:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.758408:0:5818:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff97a459238000:5818] 1 exiting: rc = 0 00000100:00100000:3.0:1788837996.758588:0:5817:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff97a459239000:5817] 0 exiting: rc = 1 00000100:00100000:1.0:1788837996.758682:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758688:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758693:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758697:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758702:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758706:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758711:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758716:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758721:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758725:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758730:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758734:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758739:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758743:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758748:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758752:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758756:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758761:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758765:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758769:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758774:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758778:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758783:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758787:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758791:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758804:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758809:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758813:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758818:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758823:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758841:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758847:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758852:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758858:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758863:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758867:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758872:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758886:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758892:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758897:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758902:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758909:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758913:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758918:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758923:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758928:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758932:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758937:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758942:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758946:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758951:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758955:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758960:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758966:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758971:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758976:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758981:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758985:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758991:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.758995:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.759009:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.759152:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.759158:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.759163:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837996.763815:0:5820:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff97a459239e00:5820] 1 exiting: rc = 0 00000100:00100000:3.0:1788837996.764133:0:5819:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff97a459238200:5819] 0 exiting: rc = 1 00000100:00100000:1.0:1788837996.764377:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764385:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764390:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764397:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764403:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764409:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764414:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764423:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764434:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764442:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764449:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764455:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764460:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764464:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764469:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764475:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764480:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764485:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764490:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764495:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764500:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764508:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764514:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764520:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764526:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764532:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764539:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764544:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764551:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764556:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764560:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764580:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764585:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764590:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764595:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764600:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764604:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764608:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764613:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764618:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764624:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764629:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764633:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764638:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764643:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764648:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764653:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764658:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764663:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764668:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764674:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764678:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764683:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764688:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764693:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764698:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764702:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764707:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764712:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764716:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764721:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764726:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764731:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.764736:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837996.765742:0:5822:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff97a4714bfe00:5822] 1 exiting: rc = 0 00000100:00100000:2.0:1788837996.766312:0:5821:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff97a44a5a9e00:5821] 0 exiting: rc = 1 00000100:00100000:2.0:1788837996.766473:0:5823:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff97a47af19200:5823] 2 exiting: rc = 0 00000100:00100000:1.0:1788837996.766692:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.766701:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.766721:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.766740:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.766748:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.766753:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.766758:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.766764:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.766769:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.766775:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.766782:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.766786:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.766792:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.766798:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.766805:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.766811:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.766816:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.766822:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.766840:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.766846:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.766852:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.766858:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.766863:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.766868:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.766873:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.766880:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.766966:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.766989:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.766997:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767003:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767009:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767093:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767099:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767104:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767110:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767117:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767122:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767136:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767143:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767149:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767155:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767160:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767167:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767173:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767180:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767186:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767191:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767197:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767350:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767356:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767362:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767382:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767389:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767394:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767400:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767405:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767410:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767416:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767422:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767428:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767434:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767440:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767446:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837996.767452:0:12944:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788837996.786885:0:12944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788837996.786902:0:12944:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788837996.786908:0:12944:0:(genops.c:885:class_export_put()) final put ffff97a461926000/MDS_uuid 00000020:00000080:1.0:1788837996.786913:0:12944:0:(genops.c:844:class_export_destroy()) destroying export ffff97a461926000/MDS_uuid for MDS 00000020:01000000:1.0:1788837996.786932:0:12944:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788837996.787566:0:12944:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788837997.092813:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837998.114632:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837998.754436:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837998.754464:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3274:1875732255036416:0@lo:400:kworker.0 00000100:00100000:1.0:1788837998.754464:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732255036160:0@lo:400:kworker.0 00000100:00100000:2.0:1788837998.754566:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732255036288:0@lo:400:kworker.0 00000400:00000100:3.0:1788837998.758111:0:3274:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875732255036416 offset 0 length 224: 4 00000400:00000100:1.0:1788837998.764640:0:3271:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875732255036160 offset 0 length 224: 4 00000400:00000100:2.0:1788837998.765695:0:3273:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875732255036288 offset 0 length 224: 4 00000001:00100000:1.0:1788837998.850909:0:7611:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788837998.850925:0:7611:0:(genops.c:885:class_export_put()) final put ffff97a458cfb800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788837998.851220:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a458cfb800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788837998.851688:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a458cfe000 for lustre-OST0001 00010000:00010000:2.0:1788837999.139801:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788837999.366850:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788837999.366865:0:6676:0:(genops.c:885:class_export_put()) final put ffff97a458c4c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788837999.366901:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a458c4c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788837999.366955:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a458c4b000 for lustre-OST0000 00010000:00010000:3.0:1788838000.163322:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788838000.694850:0:13096:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788838000.720625:0:13096:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788838000.720685:0:13096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a46e790a00/0x2deb895b363e6333 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e633a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838000.720702:0:13096:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a46e790a00/0x2deb895b363e6333 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e633a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838000.720711:0:13096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a46e790a00/0x2deb895b363e6333 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2deb895b363e633a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838000.720734:0:13096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff97a46e790a00/0x2deb895b363e6333 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2deb895b363e633a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838000.720776:0:13096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788838000.720785:0:13096:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788838000.720838:0:13096:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788838000.720854:0:13096:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a47b850e00 x1875732255036288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838014 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838000.720878:0:13096:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788838000.720884:0:13096:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788838000.720921:0:13096:0:(import.c:65:import_set_state_nolock()) ffff97a345202000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788838000.721017:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732255036288:0@lo:400:kworker.0 00000100:00100000:3.0:1788838000.721068:0:3270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3270:1875732255036544:0@lo:39:umount.0 00000400:00000100:3.0:1788838000.721123:0:3270:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875732255036544 offset 0 length 224: 4 00010000:00010000:1.0:1788838000.721347:0:7598:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838000.721362:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a46e790a00/0x2deb895b363e6333 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2deb895b363e633a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838000.721375:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e790a00 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:1.0:1788838000.721380:0:7598:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a46e790a00/0x2deb895b363e6333 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2deb895b363e633a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838000.721391:0:7598:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a46e790a00/0x2deb895b363e6333 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x2deb895b363e633a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838000.721400:0:7598:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a46e790a00/0x2deb895b363e6333 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x2deb895b363e633a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838000.721407:0:7598:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788838000.721411:0:7598:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788838000.721415:0:7598:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788838000.721466:0:7598:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a46e790a00/0x2deb895b363e6333 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x2deb895b363e633a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838000.721474:0:7598:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838000.721512:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a46e790a00/0x2deb895b363e6333 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x2deb895b363e633a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838000.721520:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a46e790a00/0x2deb895b363e6333 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x2deb895b363e633a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838000.721553:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838000.721555:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838000.721557:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838000.721963:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788838000.721990:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b09ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732255036672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838000.722071:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838000.722191:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255036672 00000100:00100000:1.0:1788838000.722237:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255036672 00000100:00100000:1.0:1788838000.722302:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788838000.722313:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3272:x1875732255036672:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788838000.722322:0:5793:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788838000 with bad export cookie 3308889376078848028 00000100:00080000:0.0:1788838000.733715:0:3272:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.154@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788838000.733725:0:3272:0:(import.c:65:import_set_state_nolock()) ffff97a4474f3800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788838000.733731:0:3272:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.154@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:1.0:1788838000.734071:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3272:x1875732255036672:12345-0@lo:103:ldlm_bl.0 Request processed in 11618us (11860us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788838000.734087:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788838000.752491:0:3272:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.154@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788838000.754091:0:3272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788838000.754107:0:3272:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a47b853b80 x1875732255036160/t0(0) o400->MGC192.168.204.154@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838014 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838000.754369:0:3272:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a47b09ad80 x1875732255036672/t0(0) o103->MGC192.168.204.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788838016 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788838000.754381:0:3272:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788838000.754385:0:3272:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788838000.754386:0:3272:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788838000.754390:0:3272:0:(import.c:65:import_set_state_nolock()) ffff97a4474f3800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838000.754396:0:3272:0:(import.c:510:import_select_connection()) MGC192.168.204.154@tcp: connect to NID 0@lo last attempt 130 00000100:00080000:0.0:1788838000.754406:0:3272:0:(import.c:624:import_select_connection()) MGC192.168.204.154@tcp: import ffff97a4474f3800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788838000.754877:0:3272:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a46ed78a80 x1875732255036800/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788838000.754933:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b09ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3272:1875732255036672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788838000.755192:0:3270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3270:1875732255036800:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:3.0:1788838000.755267:0:3270:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875732255036800 offset 0 length 520: 4 00000100:00100000:1.0:1788838000.759348:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3271:1875732255036160:0@lo:400:kworker.0 00010000:00010000:0.0:1788838001.196164:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838002.213907:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838003.234778:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788838003.874448:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) e394dacb-3a10-4fe7-bf6d-0294b37a120d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838003.874457:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) e394dacb-3a10-4fe7-bf6d-0294b37a120d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788838003.874564:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788838003.874585:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732255036928:0@lo:400:kworker.0 00000400:00000100:1.0:1788838003.874644:0:3271:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875732255036928 offset 0 length 224: 4 00010000:00010000:1.0:1788838004.258477:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838005.283135:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788838005.924354:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) e394dacb-3a10-4fe7-bf6d-0294b37a120d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788838005.924366:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) e394dacb-3a10-4fe7-bf6d-0294b37a120d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788838005.924794:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732255037056:0@lo:400:kworker.0 00000400:00000100:3.0:1788838005.924879:0:3273:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875732255037056 offset 0 length 224: 4 00010000:00010000:1.0:1788838006.306637:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838007.332152:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838008.354389:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838009.380043:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838010.018499:0:3270:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788838000/real 1788838000] req@ffff97a46ed78a80 x1875732255036800/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788838010 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838010.018536:0:3270:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97a46ed78a80 x1875732255036800/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788838010 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838010.018549:0:3270:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788838000/real 1788838000] req@ffff97a47b850380 x1875732255036544/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788838010 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838010.018560:0:3270:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97a47b850380 x1875732255036544/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788838010 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788838010.018602:0:3270:0:(import.c:65:import_set_state_nolock()) ffff97a4474f3800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838010.018630:0:3270:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788838010.018634:0:3270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3270:1875732255036800:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:0.0:1788838010.018641:0:3270:0:(import.c:65:import_set_state_nolock()) ffff97a345202000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788838010.018657:0:3270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3270:1875732255036544:0@lo:39:umount.0 00000100:00080000:1.0:1788838010.018740:0:13096:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788838010.018745:0:13096:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788838010.018749:0:13096:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788838010.019682:0:13096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6341 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6348 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838010.019699:0:13096:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6341 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e6348 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838010.019723:0:13096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6341 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2deb895b363e6348 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838010.019730:0:13096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6341 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2deb895b363e6348 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838010.019759:0:13096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838010.019767:0:13096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48a400/0x2deb895b363e6578 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e657f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838010.019774:0:13096:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48a400/0x2deb895b363e6578 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e657f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838010.019780:0:13096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48a400/0x2deb895b363e6578 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2deb895b363e657f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838010.019787:0:13096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff97a44a48a400/0x2deb895b363e6578 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2deb895b363e657f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838010.019810:0:13096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788838010.019816:0:13096:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788838010.019841:0:13096:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788838010.019846:0:13096:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788838010.019850:0:13096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788838010.019857:0:13096:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788838010.019862:0:13096:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff97a46ec619b8) has no exports 00000020:00080000:1.0:1788838010.019903:0:13096:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff97a46ec619b8) has no exports 00000020:01000000:1.0:1788838010.021520:0:13096:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97a44779b720 - data ffff97a45def8438/ffff97a344abdc00 00000100:00080000:3.0:1788838010.022251:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) e394dacb-3a10-4fe7-bf6d-0294b37a120d->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838010.022273:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788838010.022278:0:38:0:(import.c:65:import_set_state_nolock()) ffff97a4474f3800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838010.022285:0:38:0:(import.c:510:import_select_connection()) MGC192.168.204.154@tcp: connect to NID 0@lo last attempt 380 00000100:00080000:3.0:1788838010.022291:0:38:0:(import.c:589:import_select_connection()) MGC192.168.204.154@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788838010.022298:0:38:0:(import.c:624:import_select_connection()) MGC192.168.204.154@tcp: import ffff97a4474f3800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788838010.022336:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a47b850380 x1875732255037184/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838010.022402:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788838010.022417:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732255037312:0@lo:400:kworker.0 00000400:00000100:3.0:1788838010.022478:0:3273:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875732255037312 offset 0 length 224: 4 00010000:00010000:0.0:1788838010.022659:0:7597:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788838010.022675:0:7597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6341 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2deb895b363e6348 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838010.022685:0:7597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441465400 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:0.0:1788838010.022689:0:7597:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6341 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2deb895b363e6348 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838010.022700:0:7597:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6341 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2deb895b363e6348 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838010.022708:0:7597:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6341 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2deb895b363e6348 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838010.022714:0:7597:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788838010.022717:0:7597:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788838010.022720:0:7597:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788838010.022750:0:7597:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97a4474f3800 00010000:00010000:0.0:1788838010.022759:0:7597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6341 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2deb895b363e6348 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838010.022766:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a441465400/0x2deb895b363e6341 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2deb895b363e6348 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838010.022779:0:7597:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838010.022783:0:7597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a44a48a400/0x2deb895b363e6578 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2deb895b363e657f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838010.022788:0:7597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48a400 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:0.0:1788838010.022791:0:7597:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a44a48a400/0x2deb895b363e6578 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2deb895b363e657f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838010.022807:0:7597:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a44a48a400/0x2deb895b363e6578 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2deb895b363e657f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838010.022813:0:7597:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a44a48a400/0x2deb895b363e6578 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2deb895b363e657f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838010.022817:0:7597:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788838010.022819:0:7597:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788838010.022821:0:7597:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788838010.022826:0:7597:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97a4474f3800 00010000:00010000:0.0:1788838010.022829:0:7597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a44a48a400/0x2deb895b363e6578 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2deb895b363e657f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838010.022835:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a44a48a400/0x2deb895b363e6578 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2deb895b363e657f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838010.022842:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838010.022844:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838010.022846:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838010.022863:0:3270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3270:1875732255037184:0@lo:250:kworker.0 00000400:00000100:0.0:1788838010.022886:0:3270:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875732255037184 offset 0 length 520: 4 00010000:00010000:2.0:1788838010.023033:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788838010.024420:0:13096:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97a458c417e0 - data ffff97a45dc13360/ffff97a3451a3800 00100000:10000000:1.0:1788838010.034458:0:13096:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788838010.056395:0:13096:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e6150 00000020:00000080:2.0:1788838010.056418:0:13096:0:(genops.c:885:class_export_put()) final put ffff97a344b32000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788838010.056436:0:13096:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97a448f86800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788838010.056440:0:13096:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a448f86800 2 00000020:01000004:2.0:1788838010.056444:0:13096:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97a448f86800 from lustre-OST0000 00000020:00000080:2.0:1788838010.056472:0:13096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788838010.056481:0:13096:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788838010.056484:0:13096:0:(genops.c:885:class_export_put()) final put ffff97a344b33000/lustre-OST0000_UUID 00000020:00000080:2.0:1788838010.056502:0:13096:0:(genops.c:844:class_export_destroy()) destroying export ffff97a344b33000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788838010.056511:0:13096:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788838010.056585:0:13096:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788838010.056589:0:13096:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788838010.056593:0:13096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788838010.056599:0:13096:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788838010.056605:0:13096:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff97a344b36800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788838010.056612:0:13096:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff97a46e6a4d28) has exports, disconnecting them 00000020:00080000:2.0:1788838010.056617:0:13096:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff97a344b36800), last request at 1788837771 00000020:00000080:2.0:1788838010.056622:0:13096:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e617a 00000020:00080000:2.0:1788838010.056635:0:13096:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff97a344b36800): rc 0 00000020:00000080:2.0:1788838010.056641:0:13096:0:(genops.c:885:class_export_put()) final put ffff97a344b36800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788838010.057705:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97a344b32000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788838010.057724:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97a344b36800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788838010.069425:0:13096:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788838010.069436:0:13096:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788838010.069441:0:13096:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788838010.069450:0:13096:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788838010.069689:0:13096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788838010.069715:0:13096:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1788838010.069723:0:13096:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a448f86800 1 00000020:00000080:0.0:1788838010.069731:0:13096:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e610a 00000020:00000080:0.0:1788838010.069740:0:13096:0:(genops.c:885:class_export_put()) final put ffff97a449766000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788838010.069746:0:13096:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788838010.069750:0:13096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788838010.069765:0:13096:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788838010.069770:0:13096:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff97a46e6a3370) has no exports 00000020:00000080:1.0:1788838010.070096:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a345202000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788838010.070113:0:38:0:(genops.c:885:class_export_put()) final put ffff97a345205800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788838010.070116:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97a345205800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788838010.070133:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788838010.070193:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97a449766000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788838010.109880:0:13096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788838010.109897:0:13096:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788838010.109903:0:13096:0:(genops.c:885:class_export_put()) final put ffff97a448f80000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788838010.109907:0:13096:0:(genops.c:844:class_export_destroy()) destroying export ffff97a448f80000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788838010.109915:0:13096:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788838010.110376:0:13096:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97a448f82000 00000020:02000400:1.0:1788838010.110862:0:13096:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788838010.405425:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838011.427082:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838012.450810:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788838013.136319:0:13247:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788838013.145329:0:13247:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788838013.145395:0:13247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48b000/0x2deb895b363e6317 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e631e expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838013.145409:0:13247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48b000/0x2deb895b363e6317 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e631e expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838013.145416:0:13247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48b000/0x2deb895b363e6317 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2deb895b363e631e expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838013.145423:0:13247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff97a44a48b000/0x2deb895b363e6317 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2deb895b363e631e expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838013.145440:0:13247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788838013.145444:0:13247:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788838013.145464:0:13247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788838013.145475:0:13247:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a47b850a80 x1875732255036416/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838014 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838013.145528:0:13247:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a47b850e00 x1875732255036928/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838019 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838013.145539:0:13247:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a46ed7b480 x1875732255037056/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838021 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838013.145551:0:13247:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a47b853b80 x1875732255037312/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838026 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838013.145559:0:13247:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1788838013.145589:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732255037312:0@lo:400:kworker.0 00000100:00100000:3.0:1788838013.145596:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732255037056:0@lo:400:kworker.0 00000100:00080000:3.0:1788838013.145625:0:13247:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788838013.145645:0:13247:0:(import.c:65:import_set_state_nolock()) ffff97a344921000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788838013.145728:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838013.145734:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a44a48b000/0x2deb895b363e6317 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2deb895b363e631e expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838013.145741:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48b000 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:2.0:1788838013.145745:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a44a48b000/0x2deb895b363e6317 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2deb895b363e631e expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838013.145753:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a44a48b000/0x2deb895b363e6317 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2deb895b363e631e expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838013.145760:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a44a48b000/0x2deb895b363e6317 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2deb895b363e631e expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838013.145765:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788838013.145768:0:5797:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788838013.145770:0:5797:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788838013.145790:0:5797:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97a4474f3800 00010000:00010000:2.0:1788838013.145794:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a44a48b000/0x2deb895b363e6317 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2deb895b363e631e expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838013.145800:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a44a48b000/0x2deb895b363e6317 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2deb895b363e631e expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838013.145812:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838013.145814:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838013.145815:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838013.145842:0:3270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3270:1875732255037440:0@lo:39:umount.0 00000400:00000100:2.0:1788838013.145889:0:3270:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875732255037440 offset 0 length 224: 4 00000100:00100000:1.0:1788838013.146056:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3274:1875732255036416:0@lo:400:kworker.0 00000100:00100000:1.0:1788838013.146083:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732255036928:0@lo:400:kworker.0 00010000:00010000:2.0:1788838013.474517:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838014.498500:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788838015.139623:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) e394dacb-3a10-4fe7-bf6d-0294b37a120d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838015.139635:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) e394dacb-3a10-4fe7-bf6d-0294b37a120d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788838015.523050:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838016.547106:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838017.570622:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838018.594645:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838019.618638:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788838020.258384:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) e394dacb-3a10-4fe7-bf6d-0294b37a120d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838020.258401:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) e394dacb-3a10-4fe7-bf6d-0294b37a120d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788838020.642926:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838021.667343:0:7598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838022.692058:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838023.402473:0:3270:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788838013/real 1788838013] req@ffff97a47b853b80 x1875732255037440/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788838023 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838023.402524:0:3270:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97a47b853b80 x1875732255037440/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788838023 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788838023.402551:0:3270:0:(import.c:65:import_set_state_nolock()) ffff97a344921000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788838023.402676:0:3270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3270:1875732255037440:0@lo:39:umount.0 00000100:00080000:3.0:1788838023.405868:0:13247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788838023.405883:0:13247:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788838023.405893:0:13247:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788838023.406949:0:13247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a46e790600/0x2deb895b363e6325 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e632c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838023.406972:0:13247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a46e790600/0x2deb895b363e6325 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e632c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838023.406980:0:13247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a46e790600/0x2deb895b363e6325 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2deb895b363e632c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838023.407008:0:13247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff97a46e790600/0x2deb895b363e6325 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2deb895b363e632c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838023.407030:0:13247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838023.407039:0:13247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a46e790c00/0x2deb895b363e656a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e6571 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838023.407047:0:13247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a46e790c00/0x2deb895b363e656a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e6571 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838023.407054:0:13247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a46e790c00/0x2deb895b363e656a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2deb895b363e6571 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838023.407062:0:13247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff97a46e790c00/0x2deb895b363e656a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2deb895b363e6571 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838023.407089:0:13247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788838023.407096:0:13247:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788838023.407126:0:13247:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788838023.407131:0:13247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788838023.407136:0:13247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788838023.407144:0:13247:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788838023.407150:0:13247:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff97a458ce4d28) has no exports 00000020:00080000:3.0:1788838023.407185:0:13247:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff97a458ce4d28) has no exports 00010000:00010000:0.0:1788838023.409813:0:7597:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788838023.409834:0:7597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a46e790600/0x2deb895b363e6325 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2deb895b363e632c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838023.409849:0:7597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e790600 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:0.0:1788838023.409854:0:7597:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a46e790600/0x2deb895b363e6325 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2deb895b363e632c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838023.409868:0:7597:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a46e790600/0x2deb895b363e6325 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2deb895b363e632c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838023.409877:0:7597:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a46e790600/0x2deb895b363e6325 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2deb895b363e632c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838023.409883:0:7597:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788838023.409887:0:7597:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1788838023.409891:0:7597:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1788838023.409920:0:7597:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97a4474f3800 00010000:00010000:0.0:1788838023.409925:0:7597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a46e790600/0x2deb895b363e6325 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2deb895b363e632c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838023.409960:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a46e790600/0x2deb895b363e6325 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2deb895b363e632c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838023.409979:0:7597:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838023.409984:0:7597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a46e790c00/0x2deb895b363e656a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2deb895b363e6571 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838023.409990:0:7597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e790c00 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:0.0:1788838023.409993:0:7597:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a46e790c00/0x2deb895b363e656a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2deb895b363e6571 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838023.410000:0:7597:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a46e790c00/0x2deb895b363e656a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2deb895b363e6571 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838023.410007:0:7597:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a46e790c00/0x2deb895b363e656a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2deb895b363e6571 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838023.410013:0:7597:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788838023.410016:0:7597:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788838023.410018:0:7597:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788838023.410024:0:7597:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97a4474f3800 00010000:00010000:0.0:1788838023.410027:0:7597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a46e790c00/0x2deb895b363e656a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2deb895b363e6571 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838023.410033:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a46e790c00/0x2deb895b363e656a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2deb895b363e6571 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838023.410049:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838023.410051:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838023.410059:0:7597:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838023.410245:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788838023.415914:0:13247:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97a47ba8e480 - data ffff97a344cd8e58/ffff97a447607400 00000020:01000000:3.0:1788838023.416198:0:13247:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97a4590c8720 - data ffff97a47fed96c0/ffff97a345f12800 00100000:10000000:3.0:1788838023.428463:0:13247:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788838023.470449:0:13247:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e621b 00000020:00000080:2.0:1788838023.470483:0:13247:0:(genops.c:885:class_export_put()) final put ffff97a458cfb000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788838023.470706:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97a458cfb000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000004:3.0:1788838023.470737:0:13247:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97a3451f4000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788838023.470742:0:13247:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a3451f4000 2 00000020:01000004:3.0:1788838023.470746:0:13247:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97a3451f4000 from lustre-OST0001 00000020:00000080:3.0:1788838023.470777:0:13247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788838023.470789:0:13247:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788838023.470793:0:13247:0:(genops.c:885:class_export_put()) final put ffff97a449761800/lustre-OST0001_UUID 00000020:00000080:3.0:1788838023.470796:0:13247:0:(genops.c:844:class_export_destroy()) destroying export ffff97a449761800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788838023.470803:0:13247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788838023.470929:0:13247:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import e394dacb-3a10-4fe7-bf6d-0294b37a120d->MGS 00010000:00010000:3.0:1788838023.470949:0:13247:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a441465000/0x2deb895b363e612d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2deb895b363e6134 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788838023.470963:0:13247:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a441465000/0x2deb895b363e612d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2deb895b363e6134 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838023.470971:0:13247:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788838023.470974:0:13247:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788838023.470979:0:13247:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788838023.471000:0:13247:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97a4474f3800 00010000:00010000:3.0:1788838023.471004:0:13247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a441465000/0x2deb895b363e612d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2deb895b363e6134 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838023.471021:0:13247:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a46e790400/0x2deb895b363e636b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2deb895b363e6372 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788838023.471027:0:13247:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a46e790400/0x2deb895b363e636b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2deb895b363e6372 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838023.471032:0:13247:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788838023.471034:0:13247:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788838023.471036:0:13247:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788838023.471055:0:13247:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97a4474f3800 00010000:00010000:3.0:1788838023.471057:0:13247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a46e790400/0x2deb895b363e636b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2deb895b363e6372 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788838023.471075:0:13247:0:(import.c:65:import_set_state_nolock()) ffff97a4474f3800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788838023.471079:0:13247:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788838023.471081:0:13247:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788838023.471083:0:13247:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788838023.471087:0:13247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788838023.471099:0:13247:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a47b850380 x1875732255037184/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788838025 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788838023.471124:0:13247:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788838023.471129:0:13247:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:2.0:1788838023.471253:0:3270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e394dacb-3a10-4fe7-bf6d-0294b37a120d:3270:1875732255037184:0@lo:250:kworker.0 10000000:01000000:3.0:1788838023.471855:0:13247:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788838023.471868:0:13247:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e600e 00000020:00000080:3.0:1788838023.471878:0:13247:0:(genops.c:885:class_export_put()) final put ffff97a461923800/e394dacb-3a10-4fe7-bf6d-0294b37a120d 00000020:01000000:3.0:1788838023.471903:0:13247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.154@tcp (flags='') 00000020:00000080:3.0:1788838023.471911:0:13247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788838023.471920:0:13247:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.154@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788838023.471925:0:13247:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff97a448f399b8) has no exports 10000000:01000000:0.0:1788838023.472085:0:5805:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788838023.472129:0:13247:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.154@tcp: client import never connected 00000100:00080000:3.0:1788838023.472133:0:13247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788838023.472136:0:13247:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788838023.472139:0:13247:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788838023.472142:0:13247:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788838023.472173:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97a461923800/e394dacb-3a10-4fe7-bf6d-0294b37a120d for MGC192.168.204.154@tcp 00000020:00000080:3.0:1788838023.472189:0:13247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788838023.472197:0:13247:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.154@tcp (uuid e394dacb-3a10-4fe7-bf6d-0294b37a120d) 00000020:01000000:3.0:1788838023.472229:0:13247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788838023.472232:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a4474f3800 for MGC192.168.204.154@tcp 00000020:00000080:3.0:1788838023.472234:0:13247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788838023.472241:0:13247:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00000080:0.0:1788838023.472242:0:38:0:(genops.c:885:class_export_put()) final put ffff97a4474f2000/e394dacb-3a10-4fe7-bf6d-0294b37a120d 00000020:00000080:0.0:1788838023.472246:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97a4474f2000/e394dacb-3a10-4fe7-bf6d-0294b37a120d for MGC192.168.204.154@tcp 00000020:00080000:3.0:1788838023.472249:0:13247:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff97a344922800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:01000000:0.0:1788838023.472252:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.154@tcp (e394dacb-3a10-4fe7-bf6d-0294b37a120d) 00000020:00080000:3.0:1788838023.472259:0:13247:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff97a45920b370) has exports, disconnecting them 00000020:00080000:3.0:1788838023.472276:0:13247:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff97a344922800), last request at 1788837790 00000020:00000080:3.0:1788838023.472282:0:13247:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e6245 00000020:00080000:3.0:1788838023.472297:0:13247:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff97a344922800): rc 0 00000020:00000080:3.0:1788838023.472303:0:13247:0:(genops.c:885:class_export_put()) final put ffff97a344922800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788838023.477288:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97a344922800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788838023.478709:0:13247:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788838023.478720:0:13247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788838023.478726:0:13247:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788838023.478736:0:13247:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788838023.478819:0:7598:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1788838023.478978:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788838023.479126:0:7597:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000020:00000080:0.0:1788838023.479252:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a344921000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1788838023.479295:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:0.0:1788838023.479740:0:5791:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff97a450a21800:5791] 0 exiting: rc = 1 00000100:00100000:2.0:1788838023.479782:0:5792:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff97a448e1e800:5792] 1 exiting: rc = 0 00000100:00100000:2.0:1788838023.480058:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.482990:0:5794:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff97a448e1e400:5794] 1 exiting: rc = 0 00000100:00100000:0.0:1788838023.483655:0:5795:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff97a448e1f600:5795] 2 exiting: rc = 0 00000100:00100000:2.0:1788838023.484512:0:7599:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff97a46e755600:7599] 3 exiting: rc = 0 00000100:00100000:2.0:1788838023.503497:0:5793:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff97a448e1fa00:5793] 0 exiting: rc = 1 00000100:00100000:0.0:1788838023.503667:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503678:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503685:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503691:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503696:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503703:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503710:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503716:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503722:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503727:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503734:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503741:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503747:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503755:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503760:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503766:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503772:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503777:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503784:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503792:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503811:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503816:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503822:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503827:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503832:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503837:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503843:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503849:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503854:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503860:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503867:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503872:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503878:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503884:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503890:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503896:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503901:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503906:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503911:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503917:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503937:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503944:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503949:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503955:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503960:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503966:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503971:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503977:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503982:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503987:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503993:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.503999:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.504004:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.504009:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.504014:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.504026:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.504031:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.504036:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.504041:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.504046:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.504051:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.504056:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.504062:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.504067:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788838023.510576:0:13247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788838023.510592:0:13247:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788838023.510599:0:13247:0:(genops.c:885:class_export_put()) final put ffff97a458cdf000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788838023.510603:0:13247:0:(genops.c:844:class_export_destroy()) destroying export ffff97a458cdf000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788838023.510616:0:13247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1788838023.510674:0:13247:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a3451f4000 1 00000020:00000080:0.0:1788838023.510680:0:13247:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2deb895b363e61ea 00000020:00000080:0.0:1788838023.510686:0:13247:0:(genops.c:885:class_export_put()) final put ffff97a44a418800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788838023.510700:0:13247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788838023.510704:0:13247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788838023.510708:0:13247:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788838023.510712:0:13247:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff97a46f4d99b8) has no exports 00000020:00000080:3.0:1788838023.511598:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97a44a418800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788838023.533923:0:13247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788838023.533946:0:13247:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788838023.533954:0:13247:0:(genops.c:885:class_export_put()) final put ffff97a3451f5800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788838023.533961:0:13247:0:(genops.c:844:class_export_destroy()) destroying export ffff97a3451f5800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788838023.533969:0:13247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788838023.534804:0:13247:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97a3451f3800 00000020:01000000:2.0:1788838023.534840:0:13247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788838023.534847:0:13247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788838023.534854:0:13247:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788838023.534860:0:13247:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff97a46ec60000) has no exports 00000020:00000080:2.0:1788838023.534898:0:13247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788838023.534908:0:13247:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788838023.534912:0:13247:0:(genops.c:885:class_export_put()) final put ffff97a449767800/OSS_uuid 00000020:00000080:2.0:1788838023.534915:0:13247:0:(genops.c:844:class_export_destroy()) destroying export ffff97a449767800/OSS_uuid for OSS 00000020:01000000:2.0:1788838023.534919:0:13247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1788838023.536403:0:5804:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788838023.536835:0:6653:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff97a46e7b7c00:6653] 2 exiting: rc = 0 00000100:00100000:2.0:1788838023.537837:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff97a34518ca00:6682] 3 exiting: rc = 0 00000100:00100000:2.0:1788838023.537986:0:6650:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff97a4619de400:6650] 0 exiting: rc = 1 00000100:00100000:1.0:1788838023.538070:0:6652:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff97a47b1bb800:6652] 1 exiting: rc = 0 00000100:00100000:3.0:1788838023.538659:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538744:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538756:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538766:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538772:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538777:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538785:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538791:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538796:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538802:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538808:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538813:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538820:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538828:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538835:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538842:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538850:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538857:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538865:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538872:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538879:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538887:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538894:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538900:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538906:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538912:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538944:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538949:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538955:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538961:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538966:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538973:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538979:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538985:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538991:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.538997:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.539003:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.539009:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.539020:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.539030:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.539039:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.539046:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.539051:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.539057:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.539062:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.539069:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.539074:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.539080:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.539090:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.539100:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.539197:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.539223:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.539229:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.539237:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.539245:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.539252:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.539258:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.539263:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.539270:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.539277:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.539282:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.539298:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.539308:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.539331:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.543039:0:6654:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff97a47b5a0400:6654] 0 exiting: rc = 1 00000100:00100000:1.0:1788838023.543625:0:6655:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff97a448fb0e00:6655] 1 exiting: rc = 0 00000100:00100000:2.0:1788838023.543960:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.543970:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.543976:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.543982:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.543988:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.543994:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544000:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544006:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544013:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544019:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544025:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544341:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544349:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544356:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544376:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544383:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544389:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544395:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544401:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544407:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544414:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544420:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544426:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544432:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544438:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544445:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544451:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544456:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544462:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544468:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544473:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544479:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544485:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544490:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544496:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544514:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544520:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544525:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544530:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544535:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544540:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544545:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544551:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544557:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544562:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544568:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544574:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544580:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544586:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544592:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544597:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544604:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544609:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544614:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544619:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544625:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544631:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544637:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544647:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544655:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544661:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544667:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544673:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.544678:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838023.557377:0:6657:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff97a477e91a00:6657] 1 exiting: rc = 0 00000100:00100000:1.0:1788838023.557423:0:6656:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff97a477e90600:6656] 0 exiting: rc = 1 00000100:00100000:3.0:1788838023.558443:0:6658:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff97a47b5a0e00:6658] 2 exiting: rc = 0 00000100:00100000:0.0:1788838023.561433:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561446:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561453:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561459:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561466:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561472:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561478:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561484:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561490:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561496:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561503:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561510:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561516:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561542:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561548:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561554:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561560:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561567:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561584:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561590:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561596:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561602:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561608:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561615:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561621:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561627:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561633:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561640:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561646:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561652:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561658:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561663:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561669:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561674:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561680:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561686:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561691:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561698:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561704:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561710:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561716:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561722:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561740:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561746:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561752:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561757:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561763:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561769:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561779:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561785:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561792:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561798:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561804:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561810:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561817:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561823:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561829:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561835:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561842:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561849:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561865:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561873:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561880:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838023.561886:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.575198:0:6660:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff97a450a25e00:6660] 1 exiting: rc = 0 00000100:00100000:3.0:1788838023.579484:0:6659:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff97a46ebb6000:6659] 0 exiting: rc = 1 00000100:00100000:3.0:1788838023.579658:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579669:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579675:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579682:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579687:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579693:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579700:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579706:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579712:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579717:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579723:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579729:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579736:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579742:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579748:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579754:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579760:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579766:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579772:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579777:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579783:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579789:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579795:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579801:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579807:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579813:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579819:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579825:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579863:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579868:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579874:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579880:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579885:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579891:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579899:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579906:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579911:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579917:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579923:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579928:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579934:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579940:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579946:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579952:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579959:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579965:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579970:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579976:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579981:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579987:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579993:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.579999:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.580005:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.580011:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.583281:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.583306:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.583322:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.583328:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.583335:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.583340:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.583346:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.583351:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.583356:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788838023.583391:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.585177:0:6661:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff97a47b5be400:6661] 0 exiting: rc = 1 00000100:00100000:0.0:1788838023.592479:0:6662:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff97a45125b000:6662] 1 exiting: rc = 0 00000100:00100000:1.0:1788838023.593813:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.593825:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.593832:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.593858:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.593874:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.593881:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.593889:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.593896:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.593918:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.593927:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.593934:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.593941:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.593947:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.593954:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.593962:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.593986:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.593994:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594000:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594007:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594015:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594036:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594042:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594050:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594057:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594064:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594071:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594078:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594350:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594359:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594365:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594374:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594382:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594389:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594396:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594403:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594410:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594416:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594425:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594432:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594453:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594463:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594469:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594476:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594492:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594498:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594506:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594512:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594519:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594525:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594531:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594538:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594561:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594570:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594576:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594584:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594603:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594613:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594632:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594646:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594654:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594660:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594667:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594675:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788838023.594692:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788838023.623967:0:13247:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788838042.471070:0:13862:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788838052.155367:0:14322:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788838052.155376:0:14322:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788838052.155517:0:14322:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97a47b858800 00000020:01000004:2.0:1788838052.155533:0:14322:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788838052.155540:0:14322:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788838052.155562:0:14322:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff97a46ec619b8) 00000020:00000080:2.0:1788838052.155578:0:14322:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788838052.188972:0:14322:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788838052.199292:0:14322:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788838052.199644:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 247: rc = 0 00100000:10000000:2.0:1788838052.199818:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 247: rc = 0 00100000:10000000:2.0:1788838052.200040:0:14322:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788838052.200107:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 247: rc = 0 00100000:10000000:2.0:1788838052.202621:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 247: rc = 0 00100000:10000000:2.0:1788838052.203103:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 247: rc = 0 00100000:10000000:2.0:1788838052.203254:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 247: rc = 0 00100000:10000000:2.0:1788838052.203527:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 249: rc = 0 00100000:10000000:2.0:1788838052.206027:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 353: rc = 0 00100000:10000000:2.0:1788838052.206134:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 353: rc = 0 00100000:10000000:2.0:1788838052.209375:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 771: rc = 0 00100000:10000000:2.0:1788838052.209737:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 771: rc = 0 00100000:10000000:2.0:1788838052.209995:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 771: rc = 0 00100000:10000000:2.0:1788838052.210273:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 771: rc = 0 00100000:10000000:2.0:1788838052.211883:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 771: rc = 0 00100000:10000000:2.0:1788838052.213061:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 771: rc = 0 00100000:10000000:2.0:1788838052.213568:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 771: rc = 0 00100000:10000000:2.0:1788838052.214063:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 771: rc = 0 00100000:10000000:2.0:1788838052.214374:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 771: rc = 0 00100000:10000000:2.0:1788838052.215160:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 771: rc = 0 00100000:10000000:2.0:1788838052.215525:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 771: rc = 0 00100000:10000000:2.0:1788838052.215966:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 771: rc = 0 00100000:10000000:2.0:1788838052.220436:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 372: rc = 0 00100000:10000000:2.0:1788838052.220826:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 372: rc = 0 00100000:10000000:2.0:1788838052.221107:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 372: rc = 0 00100000:10000000:2.0:1788838052.221640:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 372: rc = 0 00100000:10000000:2.0:1788838052.221988:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 372: rc = 0 00100000:10000000:2.0:1788838052.222873:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 372: rc = 0 00100000:10000000:2.0:1788838052.223152:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 372: rc = 0 00100000:10000000:2.0:1788838052.223664:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 372: rc = 0 00100000:10000000:2.0:1788838052.224008:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 372: rc = 0 00100000:10000000:3.0:1788838052.225067:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 372: rc = 0 00100000:10000000:3.0:1788838052.225453:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 372: rc = 0 00100000:10000000:3.0:1788838052.225678:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 372: rc = 0 00100000:10000000:3.0:1788838052.226035:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 372: rc = 0 00100000:10000000:3.0:1788838052.226594:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 372: rc = 0 00100000:10000000:3.0:1788838052.227516:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 372: rc = 0 00100000:10000000:3.0:1788838052.227867:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 372: rc = 0 00100000:10000000:3.0:1788838052.228126:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 372: rc = 0 00100000:10000000:3.0:1788838052.229884:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 372: rc = 0 00100000:10000000:3.0:1788838052.230288:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 372: rc = 0 00100000:10000000:3.0:1788838052.230531:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 372: rc = 0 00100000:10000000:3.0:1788838052.230821:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 372: rc = 0 00100000:10000000:3.0:1788838052.231073:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 372: rc = 0 00100000:10000000:3.0:1788838052.231345:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 372: rc = 0 00100000:10000000:3.0:1788838052.231574:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 372: rc = 0 00100000:10000000:3.0:1788838052.231843:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 372: rc = 0 00100000:10000000:3.0:1788838052.232610:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 372: rc = 0 00100000:10000000:3.0:1788838052.232939:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 372: rc = 0 00100000:10000000:3.0:1788838052.233186:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 372: rc = 0 00100000:10000000:3.0:1788838052.233633:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 372: rc = 0 00100000:10000000:3.0:1788838052.234155:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 372: rc = 0 00100000:10000000:3.0:1788838052.234435:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 372: rc = 0 00100000:10000000:3.0:1788838052.234669:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 372: rc = 0 00100000:10000000:3.0:1788838052.235115:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 516: rc = 0 00100000:10000000:3.0:1788838052.235626:0:14322:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788838052.235934:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 354: rc = 0 00100000:10000000:3.0:1788838052.236121:0:14322:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788838052.236193:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 354: rc = 0 00100000:10000000:3.0:1788838052.236637:0:14322:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788838052.236704:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 354: rc = 0 00100000:10000000:3.0:1788838052.237126:0:14322:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788838052.237195:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 356: rc = 0 00100000:10000000:3.0:1788838052.237401:0:14322:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788838052.237464:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 356: rc = 0 00100000:10000000:3.0:1788838052.237639:0:14322:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788838052.237706:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 356: rc = 0 00000020:00000080:3.0:1788838052.238070:0:14322:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788838052.238078:0:14322:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788838052.238090:0:14322:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2deb895b363e730f 00000020:01000004:3.0:1788838052.238098:0:14322:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788838052.238103:0:14322:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788838052.238109:0:14322:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97a47b858800 from MGS 00000020:01000004:3.0:1788838052.238113:0:14322:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788838052.238122:0:14322:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff97a46e6a3370) 00000020:00000080:3.0:1788838052.238132:0:14322:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788838052.238188:0:14322:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a47b858800 from MGS, refs=2 00080000:01000000:3.0:1788838052.238193:0:14322:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788838052.238198:0:14322:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2deb895b363e731d 00000100:00100000:3.0:1788838052.238313:0:14322:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788838052.238455:0:14322:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788838052.238461:0:14322:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788838052.239013:0:14322:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788838052.239020:0:14322:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788838052.239703:0:14322:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788838052.239972:0:14322:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788838052.239978:0:14322:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788838052.240535:0:14322:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788838052.240542:0:14322:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788838052.240997:0:14322:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788838052.241003:0:14322:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788838052.241707:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838052.241710:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838052.241713:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838052.242057:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838052.242060:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838052.242062:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838052.242678:0:14322:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788838052.245363:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788838052.265014:0:14322:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788838052.265040:0:14322:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788838052.265043:0:14322:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788838052.268839:0:14331:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788838052.269094:0:14322:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788838052.269487:0:14322:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788838052.271536:0:14322:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788838052.273019:0:14322:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788838052.273253:0:14322:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788838052.273260:0:14322:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788838052.277041:0:14322:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788838052.277055:0:14322:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788838052.278045:0:14322:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788838052.278055:0:14322:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788838052.279797:0:14322:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788838052.279820:0:14322:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.154@tcp' 00000020:01000004:2.0:1788838052.279822:0:14322:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788838052.279852:0:14322:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.154@tcp (typ=mgc) 00000020:00000080:2.0:1788838052.279865:0:14322:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.154@tcp (ffff97a46ec64d28) 00000020:00000080:2.0:1788838052.279880:0:14322:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788838052.279968:0:14322:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a47b85c800@MGC192.168.204.154@tcp: add connection 192.168.204.154@tcp at head 00010000:00010000:2.0:1788838052.280122:0:14322:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.154@tcp-0 is initialized 00000040:01000000:2.0:1788838052.280129:0:14322:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788838052.280711:0:14335:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788838052.290598:0:14336:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788838052.290696:0:14322:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.154@tcp (uuid cfb679d1-2072-4f0b-b15a-39437d2c1c33) 00000020:00000080:3.0:1788838052.290732:0:14322:0:(genops.c:1385:class_connect()) connect: client cfb679d1-2072-4f0b-b15a-39437d2c1c33, cookie 0x2deb895b363e732b 00000100:00080000:3.0:1788838052.290744:0:14322:0:(import.c:510:import_select_connection()) MGC192.168.204.154@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788838052.290751:0:14322:0:(import.c:624:import_select_connection()) MGC192.168.204.154@tcp: import ffff97a47b85c800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788838052.290796:0:14322:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a47b851500 x1875732255037568/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838052.290824:0:14322:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import cfb679d1-2072-4f0b-b15a-39437d2c1c33->MGS 00000100:00100000:0.0:1788838052.290884:0:3270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3270:1875732255037568:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788838052.290965:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838052.291034:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255037568 00000100:00100000:0.0:1788838052.291041:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255037568 00000100:00100000:0.0:1788838052.291070:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788838052.291078:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44746f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3270:x1875732255037568:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788838052.291112:0:14332:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from cfb679d1-2072-4f0b-b15a-39437d2c1c33@0@lo t0 exp 0000000000000000 cur 432 last 0 00000020:00000080:0.0:1788838052.291139:0:14332:0:(genops.c:1385:class_connect()) connect: client cfb679d1-2072-4f0b-b15a-39437d2c1c33, cookie 0x2deb895b363e7332 00000100:00080000:0.0:1788838052.291313:0:14332:0:(import.c:65:import_set_state_nolock()) ffff97a47af55000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788838052.291364:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44746f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+5:3270:x1875732255037568:12345-0@lo:250:mount.lustre.0 Request processed in 286us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838052.291373:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788838052.291433:0:3270:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.154@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788838052.291441:0:3270:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.154@tcp: connect to target with instance 0 00000100:00080000:0.0:1788838052.291448:0:3270:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.154@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788838052.291452:0:3270:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788838052.291456:0:3270:0:(import.c:65:import_set_state_nolock()) ffff97a47b85c800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788838052.291458:0:3270:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788838052.291465:0:3270:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788838052.291470:0:3270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3270:1875732255037568:0@lo:250:mount.lustre.0 00000020:01000004:3.0:1788838052.302517:0:14322:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788838052.303294:0:14322:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788838052.303312:0:14322:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff97a458ce0000) 00000020:00000080:0.0:1788838052.303331:0:14322:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788838052.353570:0:14322:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788838052.353837:0:14322:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788838052.353843:0:14322:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788838052.360631:0:14322:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788838052.360644:0:14322:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788838052.363137:0:14322:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788838052.363149:0:14322:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788838052.365286:0:14322:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788838052.365857:0:14322:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788838052.365865:0:14322:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788838052.366622:0:14322:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788838052.366630:0:14322:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788838052.482791:0:14322:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788838052.483102:0:14322:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788838052.483109:0:14322:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788838052.485352:0:14322:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788838052.485368:0:14322:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788838052.487983:0:14322:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788838052.488597:0:14322:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788838052.488606:0:14322:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788838052.489866:0:14322:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788838052.489878:0:14322:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788838052.495341:0:14322:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788838052.495641:0:14322:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788838052.495646:0:14322:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788838052.501061:0:14322:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788838052.501078:0:14322:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788838052.505013:0:14322:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788838052.510001:0:14322:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788838052.510017:0:14322:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788838052.517914:0:14322:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788838052.517930:0:14322:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788838052.546908:0:14322:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788838052.547163:0:14322:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788838052.547169:0:14322:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788838052.552443:0:14322:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788838052.552466:0:14322:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788838052.559677:0:14322:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788838052.559691:0:14322:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788838052.566852:0:14322:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788838052.566889:0:14322:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788838052.566896:0:14322:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788838052.567045:0:14322:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788838052.567081:0:14322:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.154@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788838052.567086:0:14322:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788838052.567087:0:14322:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788838052.567089:0:14322:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788838052.567090:0:14322:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788838052.567091:0:14322:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788838052.567092:0:14322:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788838052.567094:0:14322:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788838052.567095:0:14322:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788838052.567097:0:14322:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788838052.567098:0:14322:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788838052.567101:0:14322:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788838052.567103:0:14322:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788838052.567104:0:14322:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788838052.567105:0:14322:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788838052.567106:0:14322:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788838052.567107:0:14322:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788838052.567108:0:14322:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788838052.567109:0:14322:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788838052.567110:0:14322:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788838052.567111:0:14322:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788838052.567112:0:14322:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788838052.567773:0:14322:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788838052.567797:0:14322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255037696:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788838052.567870:0:14322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838052.567962:0:14322:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448e42f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788838052.576954:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255037696 00000100:00100000:1.0:1788838052.576968:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255037696 00000100:00100000:1.0:1788838052.577039:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788838052.577049:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44746cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+5:14322:x1875732255037696:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788838052.577096:0:14334:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788838052.577099:0:14334:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788838052.577101:0:14334:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788838052.585382:0:14356:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788838052.587502:0:14334:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1788838052.591606:0:14357:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788838052.591614:0:14357:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788838052.591616:0:14357:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788838052.591648:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1788838052.592127:0:14334:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788838052.592152:0:14334:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788838052.614709:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44746cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+5:14322:x1875732255037696:12345-0@lo:253:mount.lustre.0 Request processed in 37651us (46829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838052.614724:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788838052.615164:0:14322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255037696:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788838052.615180:0:14322:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788838052.615184:0:14322:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788838052.615185:0:14322:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788838052.615187:0:14322:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788838052.615188:0:14322:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788838052.615189:0:14322:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788838052.615228:0:14322:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788838052.615242:0:14322:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788838052.615244:0:14322:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788838052.615246:0:14322:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788838052.615247:0:14322:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788838052.615265:0:14322:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97a47b858800 from lustre-MDT0000 10000000:01000000:3.0:1788838052.615296:0:14322:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788838052.615299:0:14322:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788838052.615304:0:14322:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff97a46ec64d28 10000000:01000000:3.0:1788838052.615308:0:14322:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788838052.615316:0:14322:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97a46ec64d28 from 1 10000000:01000000:3.0:1788838052.615319:0:14322:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788838052.615358:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48ac00/0x2deb895b363e7340 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838052.615518:0:14322:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a44a48ac00/0x2deb895b363e7340 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838052.615532:0:14322:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a44a48ac00/0x2deb895b363e7340 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838052.615553:0:14322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255037824:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788838052.615599:0:14322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838052.615644:0:14322:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448e42000 going to sleep for 11 seconds 00000100:00100000:0.0:1788838052.615946:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255037824 00000100:00100000:0.0:1788838052.615954:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255037824 00000100:00100000:0.0:1788838052.616008:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788838052.616018:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44746d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+5:14322:x1875732255037824:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838052.616032:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838052.616047:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a46e791a00/0x2deb895b363e7347 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e7340 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838052.616086:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a46e791a00/0x2deb895b363e7347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e7340 expref: 6 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838052.616097:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a46e791a00/0x2deb895b363e7347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e7340 expref: 6 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838052.616107:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e791a00, rc 0) 00000100:00100000:0.0:1788838052.616169:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44746d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+6:14322:x1875732255037824:12345-0@lo:101:mount.lustre.0 Request processed in 153us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838052.616176:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788838052.618405:0:14322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255037824:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788838052.618435:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a44a48ac00/0x2deb895b363e7340 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e7347 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838052.618447:0:14322:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a44a48ac00/0x2deb895b363e7340 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e7347 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838052.618528:0:14322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255037952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838052.618605:0:14322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838052.618652:0:14322:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448e42000 going to sleep for 11 seconds 00000100:00100000:1.0:1788838052.618781:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255037952 00000100:00100000:1.0:1788838052.618800:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255037952 00000100:00100000:1.0:1788838052.618862:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788838052.618872:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44746fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+6:14322:x1875732255037952:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788838052.619135:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44746fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+6:14322:x1875732255037952:12345-0@lo:501:mount.lustre.0 Request processed in 263us (528us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788838052.619143:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788838052.624140:0:14322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255037952:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788838052.624241:0:14322:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788838052.624257:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48ac00/0x2deb895b363e7340 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e7347 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838052.624268:0:14322:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a44a48ac00/0x2deb895b363e7340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e7347 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838052.624278:0:14322:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97a47b858800 10000000:01000000:3.0:1788838052.624287:0:14322:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788838052.624293:0:14322:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff97a47b858800 10000000:01000000:3.0:1788838052.624295:0:14322:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788838052.624298:0:14322:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff97a47b858800 from 1 10000000:01000000:3.0:1788838052.624301:0:14322:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788838052.624335:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e734e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838052.624343:0:14322:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e734e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838052.624355:0:14322:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e734e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838052.624390:0:14322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255038080:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788838052.624454:0:14322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838052.624505:0:14322:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448e42000 going to sleep for 11 seconds 00000100:00100000:2.0:1788838052.624736:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255038080 00000100:00100000:2.0:1788838052.624744:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255038080 00000100:00100000:2.0:1788838052.624813:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788838052.624824:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4551a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+6:14322:x1875732255038080:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788838052.624839:0:14332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838052.624856:0:14332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a47bbb5200/0x2deb895b363e7355 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e734e expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838052.624878:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a47bbb5200/0x2deb895b363e7355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e734e expref: 7 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838052.624887:0:14332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a47bbb5200/0x2deb895b363e7355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e734e expref: 7 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838052.624895:0:14332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5200, rc 0) 00000100:00100000:2.0:1788838052.624954:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4551a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+7:14322:x1875732255038080:12345-0@lo:101:mount.lustre.0 Request processed in 132us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838052.624960:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788838052.625381:0:14322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255038080:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788838052.625413:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e734e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e7355 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838052.625423:0:14322:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e734e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e7355 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838052.625439:0:14322:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788838052.625455:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e734e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e7355 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838052.625463:0:14322:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a44a48a000/0x2deb895b363e734e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e7355 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838052.625471:0:14322:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788838052.625475:0:14322:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788838052.625480:0:14322:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff97a47b858800 10000000:01000000:3.0:1788838052.625483:0:14322:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788838052.625486:0:14322:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788838052.625489:0:14322:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788838052.625520:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48aa00/0x2deb895b363e735c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838052.625527:0:14322:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a44a48aa00/0x2deb895b363e735c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838052.625535:0:14322:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a44a48aa00/0x2deb895b363e735c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838052.625550:0:14322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255038208:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788838052.625594:0:14322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838052.625628:0:14322:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448e42000 going to sleep for 11 seconds 00000100:00100000:1.0:1788838052.626411:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255038208 00000100:00100000:1.0:1788838052.626420:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255038208 00000100:00100000:1.0:1788838052.626478:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788838052.626487:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4551ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+7:14322:x1875732255038208:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788838052.626499:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838052.626514:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a458d3d600/0x2deb895b363e7363 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e735c expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838052.626534:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a458d3d600/0x2deb895b363e7363 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e735c expref: 8 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838052.626543:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a458d3d600/0x2deb895b363e7363 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e735c expref: 8 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838052.626551:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3d600, rc 0) 00000100:00100000:1.0:1788838052.626607:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4551ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+8:14322:x1875732255038208:12345-0@lo:101:mount.lustre.0 Request processed in 121us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838052.626613:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788838052.630295:0:14322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255038208:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788838052.630328:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a44a48aa00/0x2deb895b363e735c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e7363 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838052.630341:0:14322:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a44a48aa00/0x2deb895b363e735c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e7363 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838052.630424:0:14322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255038336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838052.630482:0:14322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838052.630526:0:14322:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448e42000 going to sleep for 11 seconds 00000100:00100000:0.0:1788838052.630657:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255038336 00000100:00100000:0.0:1788838052.630664:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255038336 00000100:00100000:0.0:1788838052.630716:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788838052.630726:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4551a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+8:14322:x1875732255038336:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838052.631150:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4551a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+9:14322:x1875732255038336:12345-0@lo:501:mount.lustre.0 Request processed in 425us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838052.631158:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788838052.631864:0:14322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255038336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838052.631905:0:14322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255038464:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788838052.632015:0:14322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838052.632050:0:14322:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448e42000 going to sleep for 11 seconds 00000100:00100000:2.0:1788838052.632339:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255038464 00000100:00100000:2.0:1788838052.632347:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255038464 00000100:00100000:2.0:1788838052.632393:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788838052.632403:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44969f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+9:14322:x1875732255038464:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788838052.632829:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44969f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+9:14322:x1875732255038464:12345-0@lo:503:mount.lustre.0 Request processed in 427us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838052.632837:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788838052.634399:0:14322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255038464:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788838052.635407:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed20a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14358:1875732255038592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838052.635482:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838052.635582:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a450a27f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788838052.642481:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255038592 00000100:00100000:1.0:1788838052.642497:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255038592 00000100:00100000:0.0:1788838052.645618:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788838052.645633:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44969d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+9:14358:x1875732255038592:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838052.646069:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44969d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+9:14358:x1875732255038592:12345-0@lo:502:llog_process_th.0 Request processed in 438us (10586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838052.646078:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788838052.646194:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed20a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14358:1875732255038592:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788838052.646245:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788838052.646256:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838052.646259:0:14358:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788838052.646263:0:14358:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788838052.646267:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788838052.646281:0:14358:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff97a4592099b8) 00000020:00000080:1.0:1788838052.646299:0:14358:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788838052.646305:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788838052.646380:0:14358:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788838052.646388:0:14358:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2deb895b363e7371 00000020:00000080:1.0:1788838052.646586:0:14358:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788838052.646591:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788838052.646594:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838052.646596:0:14358:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788838052.646598:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788838052.646602:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838052.646603:0:14358:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788838052.646606:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788838052.646613:0:14358:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff97a45920cd28) 00000020:00000080:1.0:1788838052.646622:0:14358:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788838052.646626:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788838052.646628:0:14358:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788838052.646630:0:14358:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788838052.646636:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788838052.646691:0:14358:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a47b858800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788838052.646704:0:14358:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff97a459208000) 00000020:00000080:1.0:1788838052.646712:0:14358:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788838052.646763:0:14358:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788838052.646769:0:14358:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2deb895b363e7386 00000020:00000080:1.0:1788838052.646858:0:14358:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788838052.646863:0:14358:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788838052.646867:0:14358:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2deb895b363e738d 00080000:01000000:1.0:1788838052.646871:0:14358:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788838052.646874:0:14358:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2deb895b363e7394 00010000:00010000:1.0:1788838052.774840:0:14358:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1788838052.775312:0:14358:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:1.0:1788838052.775501:0:14358:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788838052.778371:0:14358:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff97a45920b370) 00000020:00000080:1.0:1788838052.778399:0:14358:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788838052.778500:0:14358:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788838052.778508:0:14358:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2deb895b363e73a2 00000020:00000080:0.0:1788838052.784366:0:14358:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788838052.803095:0:14358:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2deb895b363e73a9 00000020:00000080:0.0:1788838052.805068:0:14358:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788838052.805082:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838052.805091:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838052.805093:0:14358:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788838052.805096:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838052.805101:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838052.805103:0:14358:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788838052.805107:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788838052.805599:0:14358:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788838052.805619:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838052.805624:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838052.805625:0:14358:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788838052.805628:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788838052.805630:0:14358:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1788838052.805631:0:14358:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788838052.805633:0:14358:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788838052.805634:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788838052.805636:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838052.805637:0:14358:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788838052.805640:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788838052.805643:0:14358:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788838052.805646:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838052.805647:0:14358:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788838052.805989:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788838052.805998:0:14358:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:01000000:0.0:1788838052.806030:0:14358:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788838052.806034:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788838052.806051:0:14358:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff97a458ce19b8) 00000020:00000080:0.0:1788838052.806070:0:14358:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788838052.806075:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788838052.806194:0:14358:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788838052.806371:0:14358:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788838052.806378:0:14358:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2deb895b363e73b7 00010000:00080000:0.0:1788838052.806412:0:14358:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a44a41f800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:0.0:1788838052.806635:0:14358:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1788838052.808188:0:14358:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788838052.808259:0:14358:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788838052.810150:0:14358:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788838052.810520:0:14358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788838052.810588:0:14358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788838052.811553:0:14362:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788838052.811558:0:14362:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788838052.812390:0:14358:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788838052.812402:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788838052.812434:0:14358:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788838052.812455:0:14358:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2deb895b363e73be 00000100:00080000:1.0:1788838052.812466:0:14358:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788838052.812472:0:14358:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97a44a41f800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788838052.812509:0:14358:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a47b099c00 x1875732255038720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838052.812535:0:14358:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788838052.812590:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788838052.812594:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838052.812596:0:14358:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788838052.812598:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788838052.812601:0:14358:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788838052.812602:0:14358:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788838052.812604:0:14358:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788838052.812605:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788838052.812607:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838052.812608:0:14358:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788838052.812610:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788838052.812614:0:14358:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788838052.812617:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838052.812618:0:14358:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788838052.812620:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788838052.812624:0:14358:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:01000000:1.0:1788838052.812657:0:14358:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788838052.812660:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788838052.812672:0:14358:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff97a448f399b8) 00000020:00000080:1.0:1788838052.812683:0:14358:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788838052.812688:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788838052.812741:0:14358:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788838052.812766:0:14358:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788838052.812772:0:14358:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2deb895b363e73cc 00010000:00080000:1.0:1788838052.812802:0:14358:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a4712dc800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.154@tcp at head 00000100:00100000:0.0:1788838052.813158:0:3270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3270:1875732255038720:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788838052.813250:0:3270:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875732255038720 offset 0 length 520: 4 00010000:00010000:1.0:1788838052.813496:0:14358:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788838052.813692:0:14358:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788838052.813714:0:14358:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788838052.818884:0:14358:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788838052.819058:0:14358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788838052.819531:0:14358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788838052.822988:0:14364:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788838052.822996:0:14364:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788838052.824927:0:14358:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788838052.824953:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788838052.824993:0:14358:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788838052.825014:0:14358:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2deb895b363e73d3 00000100:00080000:2.0:1788838052.825025:0:14358:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788838052.825030:0:14358:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97a4712dc800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788838052.825067:0:14358:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a46ed79500 x1875732255038848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788838052.825096:0:14358:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1788838052.825432:0:3270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3270:1875732255038848:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788838052.825487:0:3270:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875732255038848 offset 0 length 520: 4 00000020:01000000:2.0:1788838052.825633:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838052.825637:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838052.825639:0:14358:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788838052.825642:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838052.825646:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838052.825648:0:14358:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788838052.825651:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788838052.825653:0:14358:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788838052.825655:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838052.825657:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838052.825658:0:14358:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788838052.825660:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838052.825662:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838052.825664:0:14358:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788838052.825667:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788838052.825696:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed78380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14358:1875732255038976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838052.825761:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838052.825784:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4670830c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838052.826012:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255038976 00000100:00100000:1.0:1788838052.826021:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255038976 00000100:00100000:1.0:1788838052.826071:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788838052.826081:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44969cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+9:14358:x1875732255038976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838052.826363:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44969cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+9:14358:x1875732255038976:12345-0@lo:502:llog_process_th.0 Request processed in 283us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838052.826371:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788838052.826464:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed78380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14358:1875732255038976:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788838052.826491:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838052.826496:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838052.826497:0:14358:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788838052.826502:0:14358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788838052.826649:0:14322:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1788838052.826668:0:14322:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788838052.826688:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48aa00/0x2deb895b363e735c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e7363 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838052.826697:0:14322:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a44a48aa00/0x2deb895b363e735c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e7363 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838052.826704:0:14322:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97a47b858800 from 1 10000000:01000000:1.0:1788838052.826707:0:14322:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788838052.826733:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a458d3c800/0x2deb895b363e73da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838052.826741:0:14322:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a458d3c800/0x2deb895b363e73da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838052.826760:0:14322:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a458d3c800/0x2deb895b363e73da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838052.826781:0:14322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b099180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255039104:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788838052.826815:0:14322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838052.826839:0:14322:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a45127e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838052.826895:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255039104 00000100:00100000:0.0:1788838052.826900:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255039104 00000100:00100000:0.0:1788838052.826944:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788838052.826952:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44969f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+9:14322:x1875732255039104:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838052.826961:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838052.826973:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a46e790200/0x2deb895b363e73e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e73da expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838052.827007:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a46e790200/0x2deb895b363e73e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e73da expref: 10 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838052.827017:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a46e790200/0x2deb895b363e73e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e73da expref: 10 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838052.827025:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e790200, rc 0) 00000100:00100000:0.0:1788838052.827059:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44969f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+10:14322:x1875732255039104:12345-0@lo:101:mount.lustre.0 Request processed in 107us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838052.827065:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788838052.827195:0:14322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b099180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255039104:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788838052.827251:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a458d3c800/0x2deb895b363e73da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e73e1 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838052.827260:0:14322:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a458d3c800/0x2deb895b363e73da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e73e1 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838052.827815:0:14322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b099180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255039232:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788838052.827860:0:14322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838052.827884:0:14322:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a45127e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838052.828164:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255039232 00000100:00100000:1.0:1788838052.828170:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255039232 00000100:00100000:1.0:1788838052.828196:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788838052.828234:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44969ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+10:14322:x1875732255039232:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788838052.828250:0:14333:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788838052.828256:0:14333:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788838052.828321:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44969ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+10:14322:x1875732255039232:12345-0@lo:256:mount.lustre.0 Request processed in 118us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838052.828328:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788838052.828377:0:14322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b099180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255039232:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788838052.831343:0:14322:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788838052.831370:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a458d3c800/0x2deb895b363e73da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e73e1 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838052.831397:0:14322:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a458d3c800/0x2deb895b363e73da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e73e1 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838052.831492:0:14322:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a47b858800 from 1 10000000:01000000:2.0:1788838052.831496:0:14322:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788838052.831540:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4e00/0x2deb895b363e73e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838052.831560:0:14322:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4e00/0x2deb895b363e73e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838052.831571:0:14322:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4e00/0x2deb895b363e73e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838052.831596:0:14322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255039360:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788838052.831664:0:14322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838052.831719:0:14322:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a467083480 going to sleep for 11 seconds 00000100:00100000:1.0:1788838052.834331:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255039360 00000100:00100000:1.0:1788838052.834346:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255039360 00000100:00100000:1.0:1788838052.834420:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788838052.834431:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44969d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+10:14322:x1875732255039360:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788838052.834449:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838052.834470:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a458d3de00/0x2deb895b363e73ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e73e8 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838052.834498:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a458d3de00/0x2deb895b363e73ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e73e8 expref: 11 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838052.834509:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a458d3de00/0x2deb895b363e73ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e73e8 expref: 11 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838052.834519:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3de00, rc 0) 00000100:00100000:1.0:1788838052.834589:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44969d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+11:14322:x1875732255039360:12345-0@lo:101:mount.lustre.0 Request processed in 160us (2925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838052.834595:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788838052.834714:0:14322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255039360:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788838052.834734:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4e00/0x2deb895b363e73e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e73ef expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838052.834742:0:14322:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4e00/0x2deb895b363e73e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e73ef expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838052.834824:0:14322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255039488:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788838052.834859:0:14322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838052.834898:0:14322:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a467083480 going to sleep for 11 seconds 00000100:00100000:3.0:1788838052.835124:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255039488 00000100:00100000:3.0:1788838052.835130:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255039488 00000100:00100000:3.0:1788838052.835159:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788838052.835167:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44969c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+11:14322:x1875732255039488:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838052.835591:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44969c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+11:14322:x1875732255039488:12345-0@lo:501:mount.lustre.0 Request processed in 424us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838052.835609:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788838052.836302:0:14322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255039488:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788838052.836347:0:14322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255039616:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788838052.836400:0:14322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838052.836428:0:14322:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a467083480 going to sleep for 11 seconds 00000100:00100000:1.0:1788838052.837061:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255039616 00000100:00100000:1.0:1788838052.837069:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255039616 00000100:00100000:1.0:1788838052.837114:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788838052.837123:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a345183c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+11:14322:x1875732255039616:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788838052.837359:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a345183c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+11:14322:x1875732255039616:12345-0@lo:503:mount.lustre.0 Request processed in 236us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838052.837376:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788838052.838638:0:14322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255039616:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788838052.839845:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14366:1875732255039744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838052.839935:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838052.839978:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a467083600 going to sleep for 11 seconds 00000100:00100000:1.0:1788838052.840091:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255039744 00000100:00100000:1.0:1788838052.840099:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255039744 00000100:00100000:1.0:1788838052.840156:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788838052.840165:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a345183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+11:14366:x1875732255039744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838052.840464:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a345183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+11:14366:x1875732255039744:12345-0@lo:502:llog_process_th.0 Request processed in 299us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838052.840471:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788838052.840641:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14366:1875732255039744:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788838052.840667:0:14366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838052.840676:0:14366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838052.840679:0:14366:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788838052.840687:0:14366:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a47b858800 00000020:00000080:2.0:1788838052.840690:0:14366:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788838052.840698:0:14366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838052.840713:0:14366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838052.840715:0:14366:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788838052.840718:0:14366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838052.840721:0:14366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838052.840722:0:14366:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788838052.840726:0:14366:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a47b858800 00000020:00000080:2.0:1788838052.840728:0:14366:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788838052.840801:0:14366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838052.840804:0:14366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838052.840805:0:14366:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788838052.840808:0:14366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838052.840810:0:14366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838052.840812:0:14366:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788838052.840815:0:14366:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97a47b858800 00000020:00000080:2.0:1788838052.840817:0:14366:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788838052.840854:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14366:1875732255039872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838052.840889:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838052.841505:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255039872 00000100:00100000:2.0:1788838052.841513:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255039872 00000100:00100000:2.0:1788838052.841550:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788838052.841558:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a345182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+11:14366:x1875732255039872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838052.844884:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a345182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+11:14366:x1875732255039872:12345-0@lo:502:llog_process_th.0 Request processed in 3317us (3984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838052.844899:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788838052.845048:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a467083600 going to sleep for 11 seconds 00000100:00100000:2.0:1788838052.845079:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14366:1875732255039872:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788838052.845115:0:14366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838052.845124:0:14366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838052.845126:0:14366:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788838052.845133:0:14366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788838052.845336:0:14322:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788838052.845358:0:14322:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788838052.845382:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4e00/0x2deb895b363e73e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e73ef expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838052.845392:0:14322:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4e00/0x2deb895b363e73e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e73ef expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838052.845435:0:14322:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788838052.845438:0:14322:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97a47b858800 10000000:01000000:3.0:1788838052.845441:0:14322:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97a47b858800 10000000:01000000:3.0:1788838052.845445:0:14322:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788838052.845450:0:14322:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97a47b858800 from 1 10000000:01000000:3.0:1788838052.845453:0:14322:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788838052.845483:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48b000/0x2deb895b363e73f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838052.845492:0:14322:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a44a48b000/0x2deb895b363e73f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838052.845502:0:14322:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a44a48b000/0x2deb895b363e73f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838052.845521:0:14322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255040000:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788838052.845558:0:14322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838052.845580:0:14322:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448e42c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788838052.845823:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255040000 00000100:00100000:2.0:1788838052.845831:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255040000 00000100:00100000:2.0:1788838052.845874:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788838052.845882:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a345182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+11:14322:x1875732255040000:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788838052.845895:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838052.845919:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a47bbb5400/0x2deb895b363e73fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e73f6 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838052.845945:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a47bbb5400/0x2deb895b363e73fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e73f6 expref: 12 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838052.845956:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a47bbb5400/0x2deb895b363e73fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e73f6 expref: 12 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838052.845965:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5400, rc 0) 00000100:00100000:2.0:1788838052.846004:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a345182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:14322:x1875732255040000:12345-0@lo:101:mount.lustre.0 Request processed in 122us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838052.846011:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788838052.847493:0:14322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255040000:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788838052.847517:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a44a48b000/0x2deb895b363e73f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e73fd expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838052.847537:0:14322:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a44a48b000/0x2deb895b363e73f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e73fd expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838052.847612:0:14322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255040128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838052.847692:0:14322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838052.847728:0:14322:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448e42c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788838052.848102:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255040128 00000100:00100000:2.0:1788838052.848117:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255040128 00000100:00100000:2.0:1788838052.848381:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788838052.848404:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a345181050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:14322:x1875732255040128:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788838052.848671:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a345181050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:14322:x1875732255040128:12345-0@lo:501:mount.lustre.0 Request processed in 280us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838052.848678:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788838052.848799:0:14322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255040128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838052.848839:0:14322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255040256:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788838052.848883:0:14322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838052.870597:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255040256 00000100:00100000:0.0:1788838052.870613:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255040256 00000100:00100000:0.0:1788838052.870676:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788838052.870685:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a345180450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:14322:x1875732255040256:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788838052.870981:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a345180450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:14322:x1875732255040256:12345-0@lo:503:mount.lustre.0 Request processed in 296us (22096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838052.870989:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788838052.873341:0:14322:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448e42c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788838052.873386:0:14322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255040256:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788838052.880376:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b099180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14370:1875732255040384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838052.880464:0:14370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838052.880506:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a45134f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788838052.880822:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255040384 00000100:00100000:3.0:1788838052.880830:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255040384 00000100:00100000:3.0:1788838052.880886:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788838052.880895:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a345180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:14370:x1875732255040384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838052.884476:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a345180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:14370:x1875732255040384:12345-0@lo:502:llog_process_th.0 Request processed in 3571us (4001us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838052.884491:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788838052.884583:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b099180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14370:1875732255040384:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788838052.884657:0:14370:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788838052.884674:0:14370:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff97a46e6a4d28) 00000020:00000080:3.0:1788838052.884694:0:14370:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788838052.888518:0:14370:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a47b858800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788838052.888527:0:14370:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97a47b858800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788838052.888531:0:14370:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a47b858800 4 00010000:00080000:3.0:1788838052.888576:0:14370:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a44973a000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:3.0:1788838052.890307:0:14370:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1788838052.896827:0:14370:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788838052.896877:0:14370:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788838052.896892:0:14370:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2deb895b363e740b 00000100:00080000:3.0:1788838052.897277:0:14370:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788838052.897286:0:14370:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97a44973a000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788838052.897325:0:14370:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a47b853100 x1875732255040512/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838052.897450:0:3270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b853100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3270:1875732255040512:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788838052.897528:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788838052.897590:0:14370:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788838052.909662:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255040512 00000100:00100000:0.0:1788838052.909678:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255040512 00000100:00100000:0.0:1788838052.911499:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788838052.911511:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3270:x1875732255040512:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788838052.911614:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3270:x1875732255040512:12345-0@lo:38:llog_process_th.0 Request processed in 103us (14086us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788838052.911621:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788838052.911685:0:3270:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788838052.911693:0:3270:0:(import.c:65:import_set_state_nolock()) ffff97a44973a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838052.911697:0:3270:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788838052.911701:0:3270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b853100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3270:1875732255040512:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788838052.922025:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b852300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14370:1875732255040640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838052.922116:0:14370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838052.922161:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255040640 00000100:00100000:3.0:1788838052.922168:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255040640 00000100:00100000:3.0:1788838052.922238:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788838052.922248:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a345183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:14370:x1875732255040640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838052.922505:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a345183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:14370:x1875732255040640:12345-0@lo:502:llog_process_th.0 Request processed in 257us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838052.922514:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788838052.922575:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448e42a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788838052.922601:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b852300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14370:1875732255040640:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788838052.922630:0:14370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788838052.927698:0:14322:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788838052.927808:0:14322:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788838052.927830:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48b000/0x2deb895b363e73f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e73fd expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838052.927843:0:14322:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a44a48b000/0x2deb895b363e73f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e73fd expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788838052.927896:0:14322:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788838052.927898:0:14322:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788838052.927900:0:14322:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788838052.927901:0:14322:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788838052.927902:0:14322:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788838052.927904:0:14322:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788838052.927982:0:14322:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788838052.927985:0:14322:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788838052.927987:0:14322:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788838052.927988:0:14322:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788838052.927992:0:14322:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788838052.928000:0:14322:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788838052.928002:0:14322:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788838052.928003:0:14322:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788838052.928004:0:14322:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788838052.928005:0:14322:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788838052.928005:0:14322:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788838052.928006:0:14322:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788838052.928007:0:14322:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788838052.928008:0:14322:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788838052.928009:0:14322:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788838052.928038:0:14322:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788838052.928056:0:14322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b09a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255040768:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788838052.928130:0:14322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838052.928307:0:14322:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a45134f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838052.937287:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255040768 00000100:00100000:3.0:1788838052.937303:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255040768 00000100:00100000:3.0:1788838052.938961:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788838052.938980:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47c8f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:14322:x1875732255040768:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788838052.939026:0:14334:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788838052.939040:0:14334:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788838053.032695:0:14334:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788838053.032723:0:14334:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788838053.032759:0:14356:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788838053.032764:0:14356:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788838053.032797:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a46e791200/0x2deb895b363e7412 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838053.032816:0:14356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a46e790200/0x2deb895b363e73e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e73da expref: 12 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838053.032825:0:14356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a46e791200/0x2deb895b363e7412 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838053.032879:0:14356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a46e790200/0x2deb895b363e73e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e73da expref: 12 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838053.032895:0:14356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a46e790200/0x2deb895b363e73e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e73da expref: 12 pid: 14334 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838053.035063:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed20380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14356:1875732255040896:0@lo:104: 00000100:00100000:0.0:1788838053.035145:0:14356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838053.035241:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a450a27d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788838053.035273:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255040896 00000100:00100000:1.0:1788838053.035288:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255040896 00000100:00100000:1.0:1788838053.035349:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788838053.035360:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+3:14356:x1875732255040896:12345-0@lo:104: 00010000:00010000:1.0:1788838053.035380:0:14323:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a458d3c800/0x2deb895b363e73da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e73e1 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838053.035469:0:14323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788838053.035475:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+3:14356:x1875732255040896:12345-0@lo:104: Request processed in 117us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838053.035482:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788838053.035803:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed20380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14356:1875732255040896:0@lo:104: 00010000:00010000:0.0:1788838053.035842:0:14356:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a46e791200/0x2deb895b363e7412 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838053.035895:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838053.036312:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a458d3c800/0x2deb895b363e73da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e73e1 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838053.036323:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3c800 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:0.0:1788838053.036328:0:14329:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a458d3c800/0x2deb895b363e73da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e73e1 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838053.036339:0:14329:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a458d3c800/0x2deb895b363e73da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e73e1 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838053.036346:0:14329:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a458d3c800/0x2deb895b363e73da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e73e1 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838053.036352:0:14329:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838053.036414:0:14329:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a458d3c800/0x2deb895b363e73da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e73e1 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838053.036421:0:14329:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788838053.036452:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a458d3c800/0x2deb895b363e73da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e73e1 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838053.036459:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a458d3c800/0x2deb895b363e73da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e73e1 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838053.036481:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838053.036483:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838053.036485:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838053.036553:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3271:1875732255041024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838053.036628:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838053.037569:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255041024 00000100:00100000:0.0:1788838053.037587:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255041024 00010000:00010000:0.0:1788838053.037621:0:14325:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a46e790200/0x2deb895b363e73e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e73da expref: 13 pid: 14334 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838053.038327:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788838053.038341:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b099f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+13:3271:x1875732255041024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838053.038357:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838053.038366:0:14325:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a46e790200/0x2deb895b363e73e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e73da expref: 13 pid: 14334 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838053.038377:0:14325:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a46e790200/0x2deb895b363e73e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e73da expref: 13 pid: 14334 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838053.038395:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a46e790200/0x2deb895b363e73e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e73da expref: 13 pid: 14334 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838053.038412:0:14325:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a46e791200/0x2deb895b363e7412 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838053.038421:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a46e791200/0x2deb895b363e7412 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788838053.038438:0:14325:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005674819s 00010000:00010000:0.0:1788838053.038443:0:14325:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a46e791200/0x2deb895b363e7412 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838053.038450:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a46e791200/0x2deb895b363e7412 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838053.038457:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a46e791200/0x2deb895b363e7412 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838053.038476:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a46e791200/0x2deb895b363e7412 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838053.038482:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e791200 already unused, calling callback (ffffffffc1616420) 00010000:00010000:0.0:1788838053.038486:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a46e791200/0x2deb895b363e7412 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838053.038493:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a46e791200/0x2deb895b363e7412 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838053.038509:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a46e791200/0x2deb895b363e7412 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838053.038520:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838053.038598:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b099f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:3271:x1875732255041024:12345-0@lo:103:ldlm_bl.0 Request processed in 260us (1970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838053.038605:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788838053.038645:0:14356:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97a46e791200/0x2deb895b363e7412 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838053.038653:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a46e791200/0x2deb895b363e7412 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838053.038809:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a46e791200/0x2deb895b363e7412 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838053.038856:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3271:1875732255041024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838053.069111:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47c8f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+11:14322:x1875732255040768:12345-0@lo:253:mount.lustre.0 Request processed in 130124us (140968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838053.069152:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788838053.069446:0:14322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b09a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14322:1875732255040768:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788838053.069467:0:14322:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788838053.069471:0:14322:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788838053.069473:0:14322:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788838053.069481:0:14322:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788838053.069483:0:14322:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788838053.069494:0:14322:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788838053.069496:0:14322:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788838053.069498:0:14322:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788838053.069499:0:14322:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788838053.069502:0:14322:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788838053.069503:0:14322:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788838053.069521:0:14322:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788838053.094359:0:14322:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788838053.094529:0:14322:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788838053.094821:0:14322:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788838053.094974:0:14322:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788838053.095276:0:14322:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788838053.095481:0:14322:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788838053.111390:0:14322:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788838053.111656:0:14322:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788838053.111965:0:14322:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788838053.114671:0:14322:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788838053.115029:0:14322:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788838053.115196:0:14322:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1788838053.173892:0:14322:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1788838053.185059:0:14322:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788838053.185483:0:14379:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1788838053.185488:0:14379:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1788838053.185633:0:14380:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1788838053.185739:0:14380:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788838053.197524:0:14380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788838053.197608:0:14380:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788838053.197613:0:14380:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1788838053.198069:0:14322:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788838053.198533:0:14322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788838053.199068:0:14322:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788838053.199077:0:14322:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788838053.200068:0:14322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788838053.201702:0:14322:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788838053.202579:0:14322:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788838053.202622:0:14322:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1788838053.204877:0:14322:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1788838053.215859:0:14322:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788838053.278021:0:14322:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788838053.278062:0:14322:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbcc281c6f988 00100000:10000000:0.0:1788838053.278072:0:14322:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788838053.279779:0:14322:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788838053.279798:0:14322:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788838053.279814:0:14322:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1788838053.279840:0:14322:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1788838053.302031:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788838053.925794:0:14371:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1788838054.242318:0:14336:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788838054.242327:0:14336:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97a47b858800 from 6 10000000:01000000:1.0:1788838054.242331:0:14336:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788838054.242379:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a458d3d000/0x2deb895b363e7419 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838054.242391:0:14336:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a458d3d000/0x2deb895b363e7419 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838054.242402:0:14336:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a458d3d000/0x2deb895b363e7419 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838054.242428:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b09a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255041152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838054.242496:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838054.242565:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a45134fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788838054.242772:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255041152 00000100:00100000:2.0:1788838054.242781:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255041152 00000100:00100000:2.0:1788838054.242845:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788838054.242855:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47c8f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+11:14336:x1875732255041152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838054.242870:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838054.242885:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a47bbb5a00/0x2deb895b363e7420 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e7419 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838054.242909:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a47bbb5a00/0x2deb895b363e7420 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e7419 expref: 12 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838054.242932:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a47bbb5a00/0x2deb895b363e7420 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e7419 expref: 12 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838054.242940:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5a00, rc 0) 00000100:00100000:2.0:1788838054.242993:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47c8f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:14336:x1875732255041152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838054.243000:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788838054.243021:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b09a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255041152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838054.243035:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a458d3d000/0x2deb895b363e7419 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e7420 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838054.243044:0:14336:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a458d3d000/0x2deb895b363e7419 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e7420 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838054.243105:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b09a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255041280:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788838054.243151:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838054.243183:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a45134fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788838054.244315:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255041280 00000100:00100000:0.0:1788838054.244325:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255041280 00000100:00100000:0.0:1788838054.244370:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788838054.244378:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47c8f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:14336:x1875732255041280:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788838054.244397:0:14334:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788838054.244415:0:14334:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788838054.244418:0:14334:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788838054.244527:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47c8f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:14336:x1875732255041280:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 149us (1375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838054.244593:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b09a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255041280:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788838054.244642:0:14336:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788838054.244649:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a458d3d000/0x2deb895b363e7419 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e7420 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838054.244659:0:14336:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a458d3d000/0x2deb895b363e7419 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e7420 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838054.244714:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788838054.318150:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788838054.948583:0:14371:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788838055.334612:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838056.355393:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838057.380736:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788838058.146694:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788838058.146700:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788838058.146703:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788838058.146706:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788838058.146709:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788838058.146711:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838058.146715:0:8:0:(import.c:65:import_set_state_nolock()) ffff97a44973a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838058.146726:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97a44973a000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788838058.146747:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a46ed23100 x1875732255041536/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788838058.146769:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788838058.146780:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3271:1875732255041408:0@lo:400:kworker.0 00000100:00100000:0.0:1788838058.146845:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838058.146898:0:3270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3270:1875732255041536:0@lo:38:kworker.0 00000100:00100000:0.0:1788838058.146925:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838058.146984:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255041408 00000100:00100000:0.0:1788838058.146992:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255041408 00000100:00100000:0.0:1788838058.147035:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788838058.147044:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47c8f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:3271:x1875732255041408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838058.147095:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47c8f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:3271:x1875732255041408:12345-0@lo:400:kworker.0 Request processed in 52us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838058.147115:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788838058.147290:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255041536 00000100:00100000:1.0:1788838058.147295:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255041536 00000100:00100000:1.0:1788838058.147318:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788838058.147323:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3270:x1875732255041536:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788838058.147344:0:14342:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:1.0:1788838058.147395:0:14342:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2deb895b363e7427 00000004:00100000:1.0:1788838058.147409:0:14342:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788838058.147538:0:14342:0:(import.c:65:import_set_state_nolock()) ffff97a448f81800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788838058.147583:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3270:x1875732255041536:12345-0@lo:38:kworker.0 Request processed in 258us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838058.147590:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788838058.147657:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3271:1875732255041408:0@lo:400:kworker.0 00010000:00080000:1.0:1788838058.147714:0:3270:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97a46ed23100 x1875732255041536/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788838058.147728:0:3270:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788838058.147735:0:3270:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788838058.147740:0:3270:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788838058.147742:0:3270:0:(import.c:65:import_set_state_nolock()) ffff97a44973a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788838058.147747:0:3270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3270:1875732255041536:0@lo:38:kworker.0 00010000:00010000:0.0:1788838058.406483:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788838058.622144:0:14622:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788838059.430007:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838060.450444:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838061.475391:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838062.242462:0:3270:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788838052/real 1788838052] req@ffff97a46ed79500 x1875732255038848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788838062 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838062.242492:0:3270:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97a46ed79500 x1875732255038848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788838062 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838062.242503:0:3270:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788838052/real 1788838052] req@ffff97a47b099c00 x1875732255038720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788838062 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838062.242514:0:3270:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97a47b099c00 x1875732255038720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788838062 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788838062.242532:0:3270:0:(import.c:65:import_set_state_nolock()) ffff97a4712dc800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838062.242561:0:3270:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788838062.242566:0:3270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3270:1875732255038848:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788838062.242584:0:3270:0:(import.c:65:import_set_state_nolock()) ffff97a44a41f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838062.242589:0:3270:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788838062.242593:0:3270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3270:1875732255038720:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788838062.242716:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788838062.242733:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788838062.242735:0:8:0:(import.c:65:import_set_state_nolock()) ffff97a44a41f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838062.242740:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 432 00000100:00080000:1.0:1788838062.242745:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788838062.242761:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97a44a41f800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788838062.242782:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a47b09bb80 x1875732255041792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838062.242792:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3273:1875732255041664:0@lo:400:kworker.0 00000100:00080000:1.0:1788838062.242800:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788838062.242812:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788838062.242814:0:8:0:(import.c:65:import_set_state_nolock()) ffff97a4712dc800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838062.242817:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 432 00000100:00080000:1.0:1788838062.242819:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788838062.242822:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97a4712dc800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788838062.242832:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a47b09b800 x1875732255041920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838062.242855:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838062.242882:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255041664 00000100:00100000:1.0:1788838062.242889:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255041664 00000100:00100000:3.0:1788838062.242902:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788838062.242907:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732255042048:0@lo:400:kworker.0 00000100:00100000:1.0:1788838062.242931:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788838062.242932:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838062.242939:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47c8f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:3273:x1875732255041664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838062.242969:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255042048 00000100:00100000:3.0:1788838062.242973:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255042048 00000100:00100000:3.0:1788838062.243004:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788838062.243010:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732255042048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838062.243048:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732255042048:12345-0@lo:400:kworker.0 Request processed in 37us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838062.243054:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788838062.243088:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97a47b098a80 x1875732255042048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838062.243100:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732255042048:0@lo:400:kworker.0 00000100:00100000:0.0:1788838062.243148:0:3270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b09bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3270:1875732255041792:0@lo:8:kworker.0 00000400:00000100:0.0:1788838062.243172:0:3270:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875732255041792 offset 0 length 520: 4 00000100:00100000:0.0:1788838062.243186:0:3270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b09b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3270:1875732255041920:0@lo:8:kworker.0 00000100:00100000:1.0:1788838062.246291:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47c8f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:3273:x1875732255041664:12345-0@lo:400:kworker.0 Request processed in 3342us (3425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838062.246305:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000400:00000100:0.0:1788838062.246511:0:3270:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875732255041920 offset 0 length 520: 4 00000100:00100000:3.0:1788838062.249178:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3273:1875732255041664:0@lo:400:kworker.0 00000020:00000080:1.0:1788838062.491098:0:14775:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd9da8670 20000000:00000080:1.0:1788838062.491119:0:14775:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97a4718b2c00 uarg=0000000000000000 20000000:01000000:1.0:1788838062.491157:0:14775:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788838062.491165:0:14775:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788838062.491179:0:14775:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00010000:00010000:0.0:1788838062.500169:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788838062.501071:0:14776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1788838062.501329:0:14775:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788838062.519996:0:14775:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788838062.520047:0:14775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a458d3ce00/0x2deb895b363e742e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838062.520067:0:14775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a458d3de00/0x2deb895b363e73ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e73e8 expref: 11 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838062.520076:0:14775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a458d3ce00/0x2deb895b363e742e lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838062.520118:0:14775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a458d3de00/0x2deb895b363e73ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e73e8 expref: 11 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838062.520132:0:14775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a458d3de00/0x2deb895b363e73ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e73e8 expref: 11 pid: 14333 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838062.520147:0:14775:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b09b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14775:1875732255042176:0@lo:104: 00000100:00100000:1.0:1788838062.520235:0:14775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838062.520290:0:14775:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a44a56f300 going to sleep for 11 seconds 00000100:00100000:2.0:1788838062.521109:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255042176 00000100:00100000:2.0:1788838062.521118:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255042176 00000100:00100000:2.0:1788838062.521172:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788838062.521182:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b099500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+3:14775:x1875732255042176:12345-0@lo:104: 00010000:00010000:2.0:1788838062.521195:0:14324:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4e00/0x2deb895b363e73e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e73ef expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838062.521290:0:14324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788838062.521297:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b099500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+3:14775:x1875732255042176:12345-0@lo:104: Request processed in 117us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838062.521304:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788838062.521413:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838062.521420:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4e00/0x2deb895b363e73e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e73ef expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838062.521427:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4e00 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:3.0:1788838062.521431:0:14328:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4e00/0x2deb895b363e73e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e73ef expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838062.521440:0:14328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4e00/0x2deb895b363e73e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e73ef expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788838062.521447:0:14328:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4e00/0x2deb895b363e73e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e73ef expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838062.521453:0:14328:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788838062.521536:0:14328:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4e00/0x2deb895b363e73e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e73ef expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838062.521544:0:14328:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788838062.521580:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4e00/0x2deb895b363e73e8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e73ef expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838062.521588:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4e00/0x2deb895b363e73e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e73ef expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838062.521601:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3271:1875732255042304:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788838062.521605:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838062.521607:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838062.521608:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838062.521638:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838062.521804:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255042304 00000100:00100000:3.0:1788838062.521809:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255042304 00010000:00010000:3.0:1788838062.521831:0:14325:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a458d3de00/0x2deb895b363e73ef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e73e8 expref: 12 pid: 14333 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838062.521867:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788838062.521875:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:3271:x1875732255042304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788838062.521887:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838062.521892:0:14325:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a458d3de00/0x2deb895b363e73ef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e73e8 expref: 12 pid: 14333 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838062.521903:0:14325:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a458d3de00/0x2deb895b363e73ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e73e8 expref: 12 pid: 14333 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838062.521919:0:14325:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a458d3ce00/0x2deb895b363e742e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838062.521928:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a458d3ce00/0x2deb895b363e742e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838062.521942:0:14325:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a458d3ce00/0x2deb895b363e742e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838062.521948:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a458d3ce00/0x2deb895b363e742e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838062.521955:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a458d3ce00/0x2deb895b363e742e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838062.521961:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a458d3ce00/0x2deb895b363e742e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838062.521988:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3ce00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:3.0:1788838062.521992:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a458d3ce00/0x2deb895b363e742e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838062.521998:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a458d3ce00/0x2deb895b363e742e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838062.522007:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a458d3ce00/0x2deb895b363e742e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838062.522018:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788838062.522062:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:3271:x1875732255042304:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838062.522069:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788838062.522116:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3271:1875732255042304:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838062.522644:0:14775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a458d3de00/0x2deb895b363e73ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e73e8 expref: 11 pid: 14333 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838062.522657:0:14775:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b09b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14775:1875732255042176:0@lo:104: 00010000:00010000:1.0:1788838062.522672:0:14775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a458d3ce00/0x2deb895b363e742e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838062.522681:0:14775:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97a458d3ce00/0x2deb895b363e742e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838062.522700:0:14775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a458d3ce00/0x2deb895b363e742e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838062.522706:0:14775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a458d3ce00/0x2deb895b363e742e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838063.524702:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788838063.586567:0:14336:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788838063.586577:0:14336:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a47b858800 from 10 10000000:01000000:2.0:1788838063.586582:0:14336:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788838063.586642:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4200/0x2deb895b363e7435 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.586726:0:14336:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4200/0x2deb895b363e7435 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.586741:0:14336:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4200/0x2deb895b363e7435 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838063.586769:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed7a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255042432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788838063.586844:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838063.586907:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b66e180 going to sleep for 11 seconds 00000100:00100000:1.0:1788838063.587039:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255042432 00000100:00100000:1.0:1788838063.587048:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255042432 00000100:00100000:1.0:1788838063.587110:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788838063.587120:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47c8f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+11:14336:x1875732255042432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838063.587135:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838063.587150:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a458d3de00/0x2deb895b363e743c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e7435 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838063.587175:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a458d3de00/0x2deb895b363e743c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e7435 expref: 12 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838063.587186:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a458d3de00/0x2deb895b363e743c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e7435 expref: 12 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838063.587194:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3de00, rc 0) 00000100:00100000:1.0:1788838063.587370:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47c8f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:14336:x1875732255042432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 251us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838063.587377:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788838063.587616:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed7a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255042432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838063.587631:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4200/0x2deb895b363e7435 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e743c expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.587640:0:14336:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4200/0x2deb895b363e7435 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e743c expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838063.592859:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed7a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255042560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838063.592933:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838063.592990:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b66e180 going to sleep for 11 seconds 00000100:00100000:0.0:1788838063.593260:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255042560 00000100:00100000:0.0:1788838063.593269:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255042560 00000100:00100000:0.0:1788838063.593320:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788838063.593330:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47c8f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:14336:x1875732255042560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838063.593595:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47c8f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:14336:x1875732255042560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 265us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838063.593603:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788838063.593623:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed7a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255042560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838063.593791:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed7a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255042688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838063.593836:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838063.593866:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b66e180 going to sleep for 11 seconds 00000100:00100000:1.0:1788838063.593928:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255042688 00000100:00100000:1.0:1788838063.593933:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255042688 00000100:00100000:1.0:1788838063.593966:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788838063.593980:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47c8f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:14336:x1875732255042688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838063.594129:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47c8f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:14336:x1875732255042688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838063.594135:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788838063.594237:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed7a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255042688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788838063.595256:0:14804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788838063.595579:0:14336:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788838063.595598:0:14336:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788838063.595608:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4200/0x2deb895b363e7435 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e743c expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.595619:0:14336:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4200/0x2deb895b363e7435 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e743c expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788838064.166397:0:14371:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788838064.546439:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838065.570414:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838066.597156:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788838067.364233:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788838067.364243:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788838067.364246:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788838067.364250:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788838067.364303:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3272:1875732255042816:0@lo:400:kworker.0 00000100:00100000:0.0:1788838067.364403:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838067.365050:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732255042944:0@lo:400:kworker.0 00000100:00100000:0.0:1788838067.365097:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838067.365162:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255042816 00000100:00100000:0.0:1788838067.365172:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255042816 00000100:00100000:0.0:1788838067.365259:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788838067.365270:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47c8f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:3272:x1875732255042816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838067.365337:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47c8f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:3272:x1875732255042816:12345-0@lo:400:kworker.0 Request processed in 68us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838067.365345:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788838067.365386:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255042944 00000100:00100000:0.0:1788838067.365390:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255042944 00000100:00100000:0.0:1788838067.365423:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788838067.365430:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732255042944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838067.365480:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732255042944:12345-0@lo:400:kworker.0 Request processed in 40us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838067.365487:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788838067.367143:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3272:1875732255042816:0@lo:400:kworker.0 00010000:00080000:0.0:1788838067.367372:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97a46ed20000 x1875732255042944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838067.367387:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732255042944:0@lo:400:kworker.0 00010000:00010000:1.0:1788838067.620506:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838068.642694:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788838069.083607:0:15025:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788838069.083613:0:15025:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788838069.083869:0:15025:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97a47b5ac000 00000020:01000004:2.0:1788838069.083892:0:15025:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788838069.083908:0:15025:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788838069.083928:0:15025:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff97a46ec60000) 00000020:00000080:2.0:1788838069.083949:0:15025:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788838069.147530:0:15025:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788838069.148576:0:15025:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788838069.150818:0:15025:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788838069.151083:0:15025:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788838069.151360:0:15025:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788838069.151781:0:15025:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 509: rc = 0 00100000:10000000:2.0:1788838069.151882:0:15025:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 509: rc = 0 00100000:10000000:2.0:1788838069.151983:0:15025:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 509: rc = 0 00100000:10000000:2.0:1788838069.153383:0:15025:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 771: rc = 0 00100000:10000000:2.0:1788838069.155981:0:15025:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 771: rc = 0 00100000:10000000:2.0:1788838069.156544:0:15025:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 771: rc = 0 00100000:10000000:2.0:1788838069.157110:0:15025:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 771: rc = 0 00100000:10000000:3.0:1788838069.159639:0:15025:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 771: rc = 0 00100000:10000000:3.0:1788838069.159977:0:15025:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 771: rc = 0 00000020:00000080:3.0:1788838069.165456:0:15025:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788838069.165469:0:15025:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788838069.169055:0:15025:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2deb895b363e744a 00000020:01000004:3.0:1788838069.169075:0:15025:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788838069.169111:0:15025:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.154@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788838069.169115:0:15025:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788838069.169125:0:15025:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788838069.169129:0:15025:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788838069.169144:0:15025:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff97a46e6a19b8) 00000020:00000080:3.0:1788838069.169160:0:15025:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788838069.181911:0:15025:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788838069.182139:0:15025:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788838069.182146:0:15025:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788838069.184948:0:15025:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788838069.184964:0:15025:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788838069.188959:0:15025:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788838069.188972:0:15025:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788838069.195251:0:15025:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788838069.195503:0:15025:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788838069.195509:0:15025:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788838069.199451:0:15025:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788838069.199463:0:15025:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788838069.249891:0:15025:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788838069.250163:0:15025:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788838069.250170:0:15025:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788838069.256952:0:15025:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788838069.256973:0:15025:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788838069.268930:0:15025:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788838069.268961:0:15025:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788838069.271847:0:15025:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788838069.272137:0:15025:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788838069.272144:0:15025:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788838069.273380:0:15025:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788838069.273390:0:15025:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788838069.369772:0:15025:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788838069.370030:0:15025:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788838069.370036:0:15025:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788838069.386076:0:15025:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788838069.386118:0:15025:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788838069.388185:0:15025:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788838069.388238:0:15025:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788838069.388249:0:15025:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788838069.407854:0:15025:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788838069.407895:0:15025:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.154@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788838069.407900:0:15025:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788838069.407902:0:15025:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788838069.407903:0:15025:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788838069.407905:0:15025:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788838069.407906:0:15025:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788838069.407907:0:15025:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788838069.407909:0:15025:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788838069.407911:0:15025:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788838069.407912:0:15025:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788838069.407915:0:15025:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788838069.407917:0:15025:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788838069.407919:0:15025:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788838069.407920:0:15025:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788838069.407921:0:15025:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788838069.407922:0:15025:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788838069.407923:0:15025:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788838069.407924:0:15025:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788838069.407925:0:15025:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788838069.407926:0:15025:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788838069.407952:0:15025:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788838069.407973:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b851f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255043072:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788838069.408060:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838069.408226:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a45134f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838069.418446:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255043072 00000100:00100000:1.0:1788838069.418462:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255043072 00000100:00100000:1.0:1788838069.418525:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788838069.418536:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47c8f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:15025:x1875732255043072:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788838069.418573:0:14333:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788838069.418577:0:14333:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788838069.418581:0:14333:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788838069.435196:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47c8f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:15025:x1875732255043072:12345-0@lo:253:mount.lustre.0 Request processed in 16652us (27126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838069.435229:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788838069.435363:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b851f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255043072:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788838069.435380:0:15025:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788838069.435383:0:15025:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788838069.435385:0:15025:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788838069.435386:0:15025:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788838069.435387:0:15025:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788838069.435388:0:15025:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788838069.435390:0:15025:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788838069.435391:0:15025:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788838069.435394:0:15025:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788838069.435395:0:15025:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788838069.435417:0:15025:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97a47b5ac000 from lustre-OST0000 10000000:01000000:3.0:1788838069.435483:0:15025:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788838069.435486:0:15025:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788838069.435494:0:15025:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97a46ec64d28 local copy 00010000:00010000:3.0:1788838069.435505:0:15025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48ac00/0x2deb895b363e7340 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e7347 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838069.435774:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b851f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255043200:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838069.435819:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838069.435861:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a45134f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788838069.436052:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255043200 00000100:00100000:0.0:1788838069.436058:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255043200 00000100:00100000:0.0:1788838069.436107:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788838069.436116:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47c8f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:15025:x1875732255043200:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838069.436406:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47c8f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:15025:x1875732255043200:12345-0@lo:501:mount.lustre.0 Request processed in 291us (586us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788838069.436414:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788838069.436884:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b851f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255043200:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788838069.436902:0:15025:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788838069.437069:0:15025:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788838069.437078:0:15025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48ac00/0x2deb895b363e7340 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e7347 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838069.437088:0:15025:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a44a48ac00/0x2deb895b363e7340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e7347 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838069.437125:0:15025:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97a47b5ac000 10000000:01000000:3.0:1788838069.437131:0:15025:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788838069.437136:0:15025:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff97a46ec64d28 10000000:01000000:3.0:1788838069.437139:0:15025:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788838069.437143:0:15025:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff97a46ec64d28 from 1 10000000:01000000:3.0:1788838069.437146:0:15025:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788838069.437176:0:15025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48bc00/0x2deb895b363e7458 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838069.437184:0:15025:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a44a48bc00/0x2deb895b363e7458 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838069.437193:0:15025:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a44a48bc00/0x2deb895b363e7458 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838069.437227:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b851f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255043328:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788838069.437264:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838069.437301:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a45134f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788838069.437428:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255043328 00000100:00100000:0.0:1788838069.437443:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255043328 00000100:00100000:0.0:1788838069.437483:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788838069.437492:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47c8f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+12:15025:x1875732255043328:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838069.437502:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838069.437516:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a46e790400/0x2deb895b363e745f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e7458 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838069.437536:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a46e790400/0x2deb895b363e745f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e7458 expref: 13 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838069.437548:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a46e790400/0x2deb895b363e745f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e7458 expref: 13 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838069.437556:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e790400, rc 0) 00000100:00100000:0.0:1788838069.437891:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47c8f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+13:15025:x1875732255043328:12345-0@lo:101:mount.lustre.0 Request processed in 399us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838069.437899:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788838069.437991:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b851f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255043328:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788838069.438003:0:15025:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a44a48bc00/0x2deb895b363e7458 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e745f expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838069.438013:0:15025:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a44a48bc00/0x2deb895b363e7458 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e745f expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838069.438029:0:15025:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788838069.438046:0:15025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48bc00/0x2deb895b363e7458 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e745f expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838069.438067:0:15025:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a44a48bc00/0x2deb895b363e7458 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e745f expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838069.438075:0:15025:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788838069.438079:0:15025:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788838069.438084:0:15025:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788838069.438086:0:15025:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788838069.438102:0:15025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48a400/0x2deb895b363e7466 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838069.438109:0:15025:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a44a48a400/0x2deb895b363e7466 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838069.438116:0:15025:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a44a48a400/0x2deb895b363e7466 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838069.438129:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b851f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255043456:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788838069.438158:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838069.438276:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a45134f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788838069.438485:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255043456 00000100:00100000:1.0:1788838069.438492:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255043456 00000100:00100000:2.0:1788838069.438602:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788838069.438620:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47c8f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+13:15025:x1875732255043456:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788838069.438630:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838069.438650:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a47bbb4000/0x2deb895b363e746d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e7466 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838069.438667:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a47bbb4000/0x2deb895b363e746d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e7466 expref: 14 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838069.438676:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a47bbb4000/0x2deb895b363e746d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e7466 expref: 14 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838069.438684:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4000, rc 0) 00000100:00100000:2.0:1788838069.438728:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47c8f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+14:15025:x1875732255043456:12345-0@lo:101:mount.lustre.0 Request processed in 118us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838069.439034:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b851f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255043456:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788838069.439050:0:15025:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a44a48a400/0x2deb895b363e7466 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e746d expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838069.439058:0:15025:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a44a48a400/0x2deb895b363e7466 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e746d expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788838069.440156:0:15025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000100:00100000:2.0:1788838069.440417:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000040:00080000:3.0:1788838069.441675:0:15025:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788838069.441940:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788838069.441980:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788838069.442007:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788838069.442065:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788838069.442107:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788838069.442133:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788838069.442184:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788838069.442191:0:15025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788838069.442305:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b851f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255043584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838069.442367:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838069.442399:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a45134fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788838069.442711:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255043584 00000100:00100000:0.0:1788838069.442719:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255043584 00000100:00100000:0.0:1788838069.442782:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788838069.442791:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47c8f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+14:15025:x1875732255043584:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838069.443128:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47c8f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+14:15025:x1875732255043584:12345-0@lo:501:mount.lustre.0 Request processed in 337us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838069.443136:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788838069.443662:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b851f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255043584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838069.443705:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b851f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255043712:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788838069.443768:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838069.443805:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a45134fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788838069.443906:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255043712 00000100:00100000:2.0:1788838069.443911:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255043712 00000100:00100000:2.0:1788838069.443939:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788838069.443946:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a451d70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+14:15025:x1875732255043712:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788838069.444304:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a451d70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+14:15025:x1875732255043712:12345-0@lo:503:mount.lustre.0 Request processed in 357us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838069.444320:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788838069.444893:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b851f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255043712:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788838069.448143:0:15025:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788838069.450035:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255043840:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788838069.450134:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838069.450266:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f01180 going to sleep for 11 seconds 00000100:00100000:0.0:1788838069.458243:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255043840 00000100:00100000:0.0:1788838069.458269:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255043840 00000100:00100000:0.0:1788838069.458415:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788838069.458426:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a451d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+14:15025:x1875732255043840:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788838069.460171:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a451d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+14:15025:x1875732255043840:12345-0@lo:502:mount.lustre.0 Request processed in 1740us (10029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838069.460190:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788838069.461057:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255043840:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788838069.462558:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788838069.463063:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788838069.463102:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788838069.463175:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788838069.463468:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788838069.463512:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788838069.463565:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788838069.464038:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788838069.464069:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788838069.464113:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788838069.464144:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788838069.464445:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788838069.464499:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255043968:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788838069.464577:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838069.465108:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f01180 going to sleep for 11 seconds 00000100:00100000:0.0:1788838069.465173:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255043968 00000100:00100000:0.0:1788838069.465181:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255043968 00000100:00100000:2.0:1788838069.465551:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788838069.465562:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a451d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+14:15025:x1875732255043968:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788838069.466664:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a451d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+14:15025:x1875732255043968:12345-0@lo:502:mount.lustre.0 Request processed in 1099us (2082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838069.466675:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788838069.467192:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255043968:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788838069.468049:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788838069.468067:0:15025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1788838069.470498:0:15039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788838069.470508:0:15039:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788838069.470514:0:15039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838069.470517:0:15039:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788838069.470522:0:15039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788838069.470538:0:15039:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff97a458ce3370) 00000020:00000080:0.0:1788838069.470562:0:15039:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788838069.470567:0:15039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788838069.470939:0:15039:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a47b5ac000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788838069.471009:0:15039:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788838069.471016:0:15039:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2deb895b363e747b 00010000:00010000:2.0:1788838069.495199:0:15039:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1788838069.496270:0:15039:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1788838069.500070:0:15039:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788838069.504192:0:15039:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788838069.504384:0:15039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838069.504393:0:15039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838069.504395:0:15039:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788838069.504399:0:15039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788838069.504402:0:15039:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1788838069.504404:0:15039:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788838069.504406:0:15039:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788838069.504407:0:15039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788838069.504411:0:15039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838069.504420:0:15039:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788838069.504424:0:15039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838069.504438:0:15039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838069.504439:0:15039:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788838069.504444:0:15039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788838069.504446:0:15039:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788838069.504449:0:15039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838069.504451:0:15039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838069.504453:0:15039:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788838069.504457:0:15039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838069.504459:0:15039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838069.504460:0:15039:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788838069.504464:0:15039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788838069.504539:0:15039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838069.504542:0:15039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838069.504544:0:15039:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788838069.504547:0:15039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1788838069.504631:0:15025:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788838069.504657:0:15025:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788838069.504682:0:15025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48a400/0x2deb895b363e7466 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e746d expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838069.504694:0:15025:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a44a48a400/0x2deb895b363e7466 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e746d expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838069.504702:0:15025:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a47b5ac000 from 1 10000000:01000000:2.0:1788838069.504705:0:15025:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788838069.504752:0:15025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a47bbb5000/0x2deb895b363e7482 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838069.505480:0:15025:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a47bbb5000/0x2deb895b363e7482 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838069.505508:0:15025:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a47bbb5000/0x2deb895b363e7482 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838069.505535:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed7b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255044096:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788838069.506100:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838069.506192:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f01600 going to sleep for 11 seconds 00000100:00100000:0.0:1788838069.513273:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255044096 00000100:00100000:0.0:1788838069.513288:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255044096 00000100:00100000:0.0:1788838069.513387:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788838069.513408:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a451d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+14:15025:x1875732255044096:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838069.513426:0:14332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838069.513454:0:14332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a46e790c00/0x2deb895b363e7489 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e7482 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838069.513485:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a46e790c00/0x2deb895b363e7489 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e7482 expref: 15 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838069.513496:0:14332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a46e790c00/0x2deb895b363e7489 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e7482 expref: 15 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838069.513506:0:14332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e790c00, rc 0) 00000100:00100000:0.0:1788838069.513595:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a451d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+15:15025:x1875732255044096:12345-0@lo:101:mount.lustre.0 Request processed in 178us (7485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838069.513602:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788838069.514198:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed7b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255044096:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788838069.514234:0:15025:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a47bbb5000/0x2deb895b363e7482 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e7489 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838069.514246:0:15025:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a47bbb5000/0x2deb895b363e7482 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e7489 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788838069.515283:0:15025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788838069.520393:0:15025:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788838069.527094:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788838069.528460:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788838069.528619:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788838069.528628:0:15025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788838069.530498:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b851f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255044224:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838069.530568:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838069.530633:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a45134f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788838069.531569:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255044224 00000100:00100000:0.0:1788838069.531579:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255044224 00000100:00100000:0.0:1788838069.531631:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788838069.531641:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a451d71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+15:15025:x1875732255044224:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838069.532582:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a451d71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+15:15025:x1875732255044224:12345-0@lo:501:mount.lustre.0 Request processed in 938us (2010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838069.532601:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788838069.533099:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b851f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255044224:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788838069.533151:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed7b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255044352:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788838069.533327:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838069.533359:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f01cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838069.535765:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255044352 00000100:00100000:0.0:1788838069.535780:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255044352 00000100:00100000:0.0:1788838069.536167:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788838069.536178:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a451d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+15:15025:x1875732255044352:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788838069.537593:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a451d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+15:15025:x1875732255044352:12345-0@lo:503:mount.lustre.0 Request processed in 1411us (4260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838069.537617:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788838069.537748:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed7b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255044352:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788838069.538970:0:15025:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788838069.539059:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed7b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255044480:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788838069.539135:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838069.539169:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f01cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838069.539786:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255044480 00000100:00100000:0.0:1788838069.539795:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255044480 00000100:00100000:0.0:1788838069.539848:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788838069.539857:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a451d72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+15:15025:x1875732255044480:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788838069.540104:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a451d72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+15:15025:x1875732255044480:12345-0@lo:502:mount.lustre.0 Request processed in 247us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838069.540113:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788838069.540286:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed7b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255044480:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788838069.540552:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788838069.540630:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788838069.540683:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788838069.540720:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788838069.540756:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788838069.541721:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788838069.541802:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788838069.541839:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788838069.541895:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b853800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255044608:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788838069.541969:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838069.542015:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a45134f540 going to sleep for 11 seconds 00000100:00100000:0.0:1788838069.542406:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255044608 00000100:00100000:0.0:1788838069.542417:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255044608 00000100:00100000:0.0:1788838069.542480:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788838069.542489:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a451d73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+15:15025:x1875732255044608:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788838069.542758:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a451d73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+15:15025:x1875732255044608:12345-0@lo:502:mount.lustre.0 Request processed in 269us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838069.542766:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788838069.545378:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b853800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255044608:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788838069.545607:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788838069.545632:0:15025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788838069.549771:0:15043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788838069.549787:0:15043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838069.549789:0:15043:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788838069.549796:0:15043:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a47b5ac000 00000020:00000080:3.0:1788838069.549799:0:15043:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788838069.549807:0:15043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788838069.549810:0:15043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838069.549812:0:15043:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788838069.549815:0:15043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788838069.549817:0:15043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838069.549819:0:15043:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788838069.549822:0:15043:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a47b5ac000 00000020:00000080:3.0:1788838069.549824:0:15043:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788838069.549891:0:15043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788838069.549895:0:15043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838069.549896:0:15043:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788838069.549899:0:15043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788838069.549917:0:15043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838069.549919:0:15043:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788838069.549923:0:15043:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97a47b5ac000 00000020:00000080:3.0:1788838069.549926:0:15043:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788838069.549967:0:15043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788838069.549971:0:15043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838069.549972:0:15043:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788838069.549975:0:15043:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788838069.554812:0:15025:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788838069.554856:0:15025:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788838069.554876:0:15025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a47bbb5000/0x2deb895b363e7482 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e7489 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838069.554890:0:15025:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a47bbb5000/0x2deb895b363e7482 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e7489 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838069.554943:0:15025:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788838069.554946:0:15025:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97a47b5ac000 10000000:01000000:0.0:1788838069.554949:0:15025:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97a47b5ac000 10000000:01000000:0.0:1788838069.554952:0:15025:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788838069.554964:0:15025:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97a47b5ac000 from 1 10000000:01000000:0.0:1788838069.554967:0:15025:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788838069.555005:0:15025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a46e790600/0x2deb895b363e7490 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838069.555014:0:15025:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a46e790600/0x2deb895b363e7490 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838069.555027:0:15025:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a46e790600/0x2deb895b363e7490 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838069.555050:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255044736:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788838069.555953:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838069.556010:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f9fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788838069.556095:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255044736 00000100:00100000:1.0:1788838069.556851:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255044736 00000100:00100000:1.0:1788838069.556913:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788838069.556923:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a451d70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+15:15025:x1875732255044736:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788838069.556942:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838069.556958:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a458d3c000/0x2deb895b363e7497 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e7490 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838069.556986:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a458d3c000/0x2deb895b363e7497 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e7490 expref: 16 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838069.556997:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a458d3c000/0x2deb895b363e7497 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e7490 expref: 16 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838069.557007:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3c000, rc 0) 00000100:00100000:1.0:1788838069.557069:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a451d70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+16:15025:x1875732255044736:12345-0@lo:101:mount.lustre.0 Request processed in 147us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838069.557076:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788838069.557336:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255044736:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838069.557353:0:15025:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a46e790600/0x2deb895b363e7490 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e7497 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838069.557363:0:15025:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a46e790600/0x2deb895b363e7490 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e7497 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788838069.557966:0:15025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1788838069.562581:0:15025:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788838069.566390:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788838069.566458:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788838069.566493:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788838069.566547:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788838069.566583:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788838069.566638:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788838069.567093:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788838069.569845:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788838069.569939:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788838069.569976:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788838069.570005:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788838069.570050:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788838069.570084:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788838069.570113:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788838069.570153:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788838069.570184:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788838069.570861:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788838069.570934:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788838069.570991:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788838069.571081:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788838069.571153:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788838069.571187:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788838069.572126:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788838069.572256:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788838069.572297:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788838069.572341:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788838069.572382:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788838069.572411:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788838069.572513:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788838069.572521:0:15025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788838069.573006:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b853800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255044864:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838069.573083:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838069.573228:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4508c7180 going to sleep for 11 seconds 00000100:00100000:0.0:1788838069.574750:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255044864 00000100:00100000:0.0:1788838069.575728:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255044864 00000100:00100000:0.0:1788838069.575944:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788838069.575956:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a451d71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+16:15025:x1875732255044864:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838069.578438:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a451d71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+16:15025:x1875732255044864:12345-0@lo:501:mount.lustre.0 Request processed in 2465us (5335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838069.578452:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788838069.580353:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b853800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255044864:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788838069.581254:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed78e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255044992:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788838069.582034:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838069.582082:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b66e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788838069.582413:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255044992 00000100:00100000:2.0:1788838069.582421:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255044992 00000100:00100000:2.0:1788838069.582487:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788838069.582497:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a451d71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+16:15025:x1875732255044992:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788838069.584153:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a451d71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+16:15025:x1875732255044992:12345-0@lo:503:mount.lustre.0 Request processed in 1650us (2112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838069.584165:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788838069.588322:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed78e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255044992:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788838069.588934:0:15025:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788838069.589015:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255045120:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788838069.589086:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838069.589127:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f9fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788838069.590496:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255045120 00000100:00100000:2.0:1788838069.590508:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255045120 00000100:00100000:2.0:1788838069.590576:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788838069.590598:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a451d71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+16:15025:x1875732255045120:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788838069.591184:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a451d71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+16:15025:x1875732255045120:12345-0@lo:502:mount.lustre.0 Request processed in 586us (2095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838069.591192:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788838069.591969:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255045120:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788838069.592735:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788838069.593476:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788838069.593520:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788838069.593576:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788838069.594696:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788838069.596444:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788838069.596534:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788838069.596580:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788838069.598745:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788838069.600962:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788838069.601020:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788838069.601102:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788838069.601138:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788838069.601184:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788838069.601250:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788838069.601287:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788838069.608490:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788838069.608632:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788838069.608690:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788838069.608723:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788838069.608786:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788838069.608822:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788838069.608852:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788838069.608894:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788838069.608926:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788838069.608955:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788838069.608996:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788838069.609027:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788838069.609056:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788838069.609111:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788838069.609143:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788838069.609172:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788838069.609199:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788838069.609269:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788838069.609711:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788838069.609877:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788838069.609919:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788838069.609953:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788838069.610002:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788838069.610038:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788838069.610103:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b09b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255045248:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788838069.610189:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838069.610253:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a449a34240 going to sleep for 11 seconds 00000100:00100000:0.0:1788838069.610370:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255045248 00000100:00100000:0.0:1788838069.610376:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255045248 00000100:00100000:0.0:1788838069.610442:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788838069.610452:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a451d72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+16:15025:x1875732255045248:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788838069.610684:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a451d72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+16:15025:x1875732255045248:12345-0@lo:502:mount.lustre.0 Request processed in 232us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838069.610692:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788838069.612286:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b09b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255045248:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788838069.613003:0:15025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788838069.613018:0:15025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788838069.625176:0:15048:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788838069.625195:0:15048:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff97a46e6a0000) 00000020:00000080:3.0:1788838069.625237:0:15048:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788838069.625333:0:15048:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a47b5ac000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788838069.625338:0:15048:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97a47b5ac000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788838069.625341:0:15048:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a47b5ac000 3 00010000:00080000:3.0:1788838069.625371:0:15048:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a458cf8800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.154@tcp at head 00010000:00010000:2.0:1788838069.629602:0:15048:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1788838069.630850:0:15048:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788838069.630890:0:15048:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788838069.630904:0:15048:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2deb895b363e74a5 00000100:00080000:2.0:1788838069.630916:0:15048:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788838069.630921:0:15048:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97a458cf8800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788838069.630959:0:15048:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a46ed79180 x1875732255045376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788838069.630985:0:15048:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788838069.631508:0:3270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3270:1875732255045376:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788838069.631586:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838069.633307:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255045376 00000100:00100000:2.0:1788838069.633332:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255045376 00000100:00100000:2.0:1788838069.633380:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788838069.633388:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3270:x1875732255045376:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788838069.633419:0:14342:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:2.0:1788838069.633478:0:14342:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2deb895b363e74ac 00000004:00100000:2.0:1788838069.633496:0:14342:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788838069.633531:0:14342:0:(import.c:65:import_set_state_nolock()) ffff97a458cfa800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788838069.633610:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3270:x1875732255045376:12345-0@lo:38:llog_process_th.0 Request processed in 222us (2024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838069.633618:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788838069.634496:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788838069.634502:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788838069.634505:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788838069.634508:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788838069.635356:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b09b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3274:1875732255045504:0@lo:400:kworker.0 00000100:00100000:0.0:1788838069.635419:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788838069.635513:0:3270:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97a46ed79180 x1875732255045376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838069.635526:0:3270:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788838069.635536:0:3270:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788838069.635544:0:3270:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788838069.635549:0:3270:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788838069.635552:0:3270:0:(import.c:65:import_set_state_nolock()) ffff97a458cf8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788838069.635559:0:3270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3270:1875732255045376:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788838069.635786:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255045504 00000100:00100000:1.0:1788838069.635793:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255045504 00000100:00100000:1.0:1788838069.635840:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788838069.635850:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1875732255045504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838069.635904:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1875732255045504:12345-0@lo:400:kworker.0 Request processed in 56us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838069.635919:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788838069.635951:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97a47b09b480 x1875732255045504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838069.635962:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b09b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3274:1875732255045504:0@lo:400:kworker.0 00000040:00080000:2.0:1788838069.636671:0:15048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788838069.637993:0:15025:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788838069.638029:0:15025:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788838069.638053:0:15025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a46e790600/0x2deb895b363e7490 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e7497 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838069.638065:0:15025:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a46e790600/0x2deb895b363e7490 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e7497 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788838069.638118:0:15025:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788838069.638120:0:15025:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788838069.638122:0:15025:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788838069.638123:0:15025:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788838069.638125:0:15025:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788838069.638126:0:15025:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788838069.638128:0:15025:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788838069.638130:0:15025:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788838069.638132:0:15025:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788838069.638136:0:15025:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788838069.638138:0:15025:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788838069.638140:0:15025:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788838069.638141:0:15025:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788838069.638142:0:15025:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788838069.638143:0:15025:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788838069.638144:0:15025:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788838069.638145:0:15025:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788838069.638146:0:15025:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788838069.638148:0:15025:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788838069.638176:0:15025:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788838069.638197:0:15025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b09b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255045632:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788838069.638309:0:15025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838069.638361:0:15025:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a449a34300 going to sleep for 11 seconds 00000100:00100000:2.0:1788838069.638664:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255045632 00000100:00100000:2.0:1788838069.638673:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255045632 00000100:00100000:2.0:1788838069.638722:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788838069.638731:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a451d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+16:15025:x1875732255045632:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788838069.638758:0:14332:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788838069.638774:0:14332:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:3.0:1788838069.668050:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:2.0:1788838069.700863:0:14332:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788838069.700886:0:14332:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788838069.701014:0:14356:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788838069.701020:0:14356:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788838069.701044:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a44a48a800/0x2deb895b363e74b3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838069.701064:0:14356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a47bbb5a00/0x2deb895b363e7420 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e7419 expref: 16 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838069.701073:0:14356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a44a48a800/0x2deb895b363e74b3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838069.701125:0:14356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a47bbb5a00/0x2deb895b363e7420 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e7419 expref: 16 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838069.701139:0:14356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a47bbb5a00/0x2deb895b363e7420 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e7419 expref: 16 pid: 14333 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838069.701153:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b851880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14356:1875732255045760:0@lo:104: 00000100:00100000:3.0:1788838069.701234:0:14356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838069.701290:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a449ec7480 going to sleep for 11 seconds 00000100:00100000:3.0:1788838069.701389:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255045760 00000100:00100000:3.0:1788838069.701402:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255045760 00000100:00100000:3.0:1788838069.701458:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788838069.701467:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b851c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+3:14356:x1875732255045760:12345-0@lo:104: 00010000:00010000:3.0:1788838069.701479:0:14324:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a458d3d000/0x2deb895b363e7419 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e7420 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838069.701543:0:14324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788838069.701550:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b851c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+3:14356:x1875732255045760:12345-0@lo:104: Request processed in 84us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838069.701557:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788838069.701724:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838069.701732:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a458d3d000/0x2deb895b363e7419 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e7420 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838069.701740:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3d000 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:3.0:1788838069.701745:0:14328:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a458d3d000/0x2deb895b363e7419 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e7420 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838069.701753:0:14328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a458d3d000/0x2deb895b363e7419 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e7420 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788838069.701761:0:14328:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a458d3d000/0x2deb895b363e7419 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e7420 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838069.701768:0:14328:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788838069.701798:0:14328:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a458d3d000/0x2deb895b363e7419 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e7420 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838069.701805:0:14328:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788838069.701827:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a458d3d000/0x2deb895b363e7419 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e7420 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838069.701841:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a458d3d000/0x2deb895b363e7419 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e7420 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838069.701857:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838069.701859:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838069.701860:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838069.701885:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3271:1875732255045888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788838069.701914:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838069.702287:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255045888 00000100:00100000:1.0:1788838069.702292:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255045888 00010000:00010000:1.0:1788838069.702311:0:14325:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a47bbb5a00/0x2deb895b363e7420 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e7419 expref: 17 pid: 14333 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838069.702336:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788838069.702344:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b852a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+17:3271:x1875732255045888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838069.702355:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838069.702360:0:14325:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a47bbb5a00/0x2deb895b363e7420 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e7419 expref: 17 pid: 14333 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838069.702372:0:14325:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a47bbb5a00/0x2deb895b363e7420 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e7419 expref: 17 pid: 14333 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838069.702389:0:14325:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a44a48a800/0x2deb895b363e74b3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838069.702397:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a44a48a800/0x2deb895b363e74b3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788838069.702411:0:14325:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005674819s 00010000:00010000:1.0:1788838069.702415:0:14325:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a44a48a800/0x2deb895b363e74b3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838069.702577:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a44a48a800/0x2deb895b363e74b3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838069.702588:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a44a48a800/0x2deb895b363e74b3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838069.702761:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a44a48a800/0x2deb895b363e74b3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838069.702767:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48a800 already unused, calling callback (ffffffffc1616420) 00010000:00010000:1.0:1788838069.702771:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a44a48a800/0x2deb895b363e74b3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838069.702778:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a44a48a800/0x2deb895b363e74b3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838069.702788:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a44a48a800/0x2deb895b363e74b3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838069.702798:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838069.702844:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b852a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+17:3271:x1875732255045888:12345-0@lo:103:ldlm_bl.0 Request processed in 501us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838069.702851:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788838069.702890:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3271:1875732255045888:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788838069.703334:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a47bbb5a00/0x2deb895b363e7420 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e7419 expref: 16 pid: 14333 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838069.703348:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b851880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14356:1875732255045760:0@lo:104: 00010000:00010000:2.0:1788838069.703363:0:14356:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a44a48a800/0x2deb895b363e74b3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838069.703373:0:14356:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97a44a48a800/0x2deb895b363e74b3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838069.703392:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a44a48a800/0x2deb895b363e74b3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838069.703398:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a44a48a800/0x2deb895b363e74b3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838069.710633:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a451d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+15:15025:x1875732255045632:12345-0@lo:253:mount.lustre.0 Request processed in 70930us (71352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838069.710651:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788838069.710794:0:15025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b09b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15025:1875732255045632:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788838069.710812:0:15025:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788838069.710817:0:15025:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788838069.710818:0:15025:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788838069.710820:0:15025:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788838069.710821:0:15025:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788838069.710822:0:15025:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788838069.710824:0:15025:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788838069.710825:0:15025:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788838069.710827:0:15025:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788838069.710829:0:15025:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788838069.710850:0:15025:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788838069.715940:0:15025:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788838069.716109:0:15025:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788838069.716420:0:15025:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788838069.716587:0:15025:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788838069.716753:0:15025:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788838069.716915:0:15025:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788838069.718605:0:15025:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788838069.850739:0:15025:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788838069.850753:0:15025:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788838069.850805:0:15025:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788838069.850885:0:15025:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788838069.850905:0:15025:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788838069.850950:0:15025:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788838070.691608:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788838071.267447:0:14336:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788838071.267456:0:14336:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97a47b858800 from 7 10000000:01000000:3.0:1788838071.267461:0:14336:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788838071.267521:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48ae00/0x2deb895b363e74ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.267533:0:14336:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a44a48ae00/0x2deb895b363e74ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.267544:0:14336:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a44a48ae00/0x2deb895b363e74ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838071.267571:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b850700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255046016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788838071.267788:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838071.267841:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a460111180 going to sleep for 11 seconds 00000100:00100000:1.0:1788838071.268014:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255046016 00000100:00100000:1.0:1788838071.268036:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255046016 00000100:00100000:1.0:1788838071.268095:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788838071.268104:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a451d70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+15:14336:x1875732255046016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838071.268117:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838071.268131:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a458d3d000/0x2deb895b363e74c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e74ba expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.268155:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a458d3d000/0x2deb895b363e74c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e74ba expref: 16 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.268166:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a458d3d000/0x2deb895b363e74c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e74ba expref: 16 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.268175:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3d000, rc 0) 00000100:00100000:1.0:1788838071.268246:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a451d70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+16:14336:x1875732255046016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838071.268254:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788838071.270906:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b850700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255046016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838071.270937:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a44a48ae00/0x2deb895b363e74ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e74c1 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.270962:0:14336:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a44a48ae00/0x2deb895b363e74ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e74c1 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838071.271036:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b850700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255046144:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788838071.271100:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838071.271184:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a460111180 going to sleep for 11 seconds 00000100:00100000:1.0:1788838071.278893:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255046144 00000100:00100000:1.0:1788838071.278909:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255046144 00000100:00100000:1.0:1788838071.279037:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788838071.279048:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a0c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+16:14336:x1875732255046144:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788838071.279076:0:14332:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788838071.279100:0:14332:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788838071.279103:0:14332:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788838071.279263:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a0c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+16:14336:x1875732255046144:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 215us (8162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838071.279271:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788838071.282711:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b850700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255046144:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788838071.282820:0:14336:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788838071.282831:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48ae00/0x2deb895b363e74ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e74c1 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.282842:0:14336:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a44a48ae00/0x2deb895b363e74ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e74c1 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.719882:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838072.743864:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838073.767757:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788838074.407427:0:14371:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788838074.786560:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788838075.045606:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788838075.045615:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788838075.045618:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788838075.045622:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788838075.047118:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3274:1875732255046528:0@lo:400:kworker.0 00000100:00100000:2.0:1788838075.047275:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838075.047371:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788838075.047379:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3274:1875732255046400:0@lo:400:kworker.0 00000100:00100000:2.0:1788838075.047411:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838075.047449:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255046528 00000100:00100000:2.0:1788838075.047459:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255046528 00000100:00100000:2.0:1788838075.047527:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255046400 00000100:00100000:2.0:1788838075.047531:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255046400 00000100:00100000:2.0:1788838075.047550:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788838075.047559:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1875732255046528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838075.047635:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1875732255046528:12345-0@lo:400:kworker.0 Request processed in 76us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838075.047660:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788838075.047681:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788838075.047686:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1875732255046400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838075.047715:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1875732255046400:12345-0@lo:400:kworker.0 Request processed in 29us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838075.047721:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788838075.049100:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3272:1875732255046272:0@lo:400:kworker.0 00000100:00100000:3.0:1788838075.049392:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788838075.049491:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788838075.049620:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255046272 00000100:00100000:3.0:1788838075.049629:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255046272 00000100:00100000:3.0:1788838075.049680:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788838075.049690:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46008a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+16:3272:x1875732255046272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838075.049787:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46008a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+16:3272:x1875732255046272:12345-0@lo:400:kworker.0 Request processed in 99us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838075.049795:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788838075.049870:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3272:1875732255046272:0@lo:400:kworker.0 00010000:00080000:2.0:1788838075.054684:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a46ed78000 x1875732255046400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838075.054713:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3274:1875732255046400:0@lo:400:kworker.0 00010000:00080000:2.0:1788838075.054732:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a46ed79f80 x1875732255046528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838075.054742:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3274:1875732255046528:0@lo:400:kworker.0 00010000:00010000:0.0:1788838075.815738:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838076.834378:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838077.863945:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838077.864517:0:3270:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788838062/real 1788838062] req@ffff97a47b09bb80 x1875732255041792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788838077 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838077.864551:0:3270:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97a47b09bb80 x1875732255041792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788838077 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838077.864563:0:3270:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788838062/real 1788838062] req@ffff97a47b09b800 x1875732255041920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788838077 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838077.864574:0:3270:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97a47b09b800 x1875732255041920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788838077 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788838077.864593:0:3270:0:(import.c:65:import_set_state_nolock()) ffff97a44a41f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838077.864626:0:3270:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788838077.864642:0:3270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b09bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3270:1875732255041792:0@lo:8:kworker.0 00000100:00080000:2.0:1788838077.864649:0:3270:0:(import.c:65:import_set_state_nolock()) ffff97a4712dc800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838077.864654:0:3270:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788838077.864657:0:3270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b09b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3270:1875732255041920:0@lo:8:kworker.0 00000100:00080000:0.0:1788838077.864849:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788838077.864853:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788838077.864856:0:36:0:(import.c:65:import_set_state_nolock()) ffff97a44a41f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838077.864861:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 442 00000100:00080000:0.0:1788838077.864866:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788838077.864872:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97a44a41f800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788838077.864891:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a46ed23b80 x1875732255046784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838077.864902:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788838077.864905:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788838077.864907:0:36:0:(import.c:65:import_set_state_nolock()) ffff97a4712dc800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838077.864909:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 442 00000100:00080000:0.0:1788838077.864912:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788838077.864915:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97a4712dc800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788838077.864923:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a46ed21c00 x1875732255046912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788838077.864973:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3272:1875732255047040:0@lo:400:kworker.0 00000100:00100000:0.0:1788838077.865035:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838077.865084:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788838077.865090:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3272:1875732255046656:0@lo:400:kworker.0 00000100:00100000:0.0:1788838077.865118:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838077.865149:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732255047168:0@lo:400:kworker.0 00000100:00100000:0.0:1788838077.865172:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838077.865224:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255046656 00000100:00100000:0.0:1788838077.865232:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255046656 00000100:00100000:0.0:1788838077.865290:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788838077.865300:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46008a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+16:3272:x1875732255046656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838077.865348:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46008a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+16:3272:x1875732255046656:12345-0@lo:400:kworker.0 Request processed in 49us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838077.865355:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788838077.865390:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255047040 00000100:00100000:0.0:1788838077.865394:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255047040 00000100:00100000:0.0:1788838077.865415:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255047168 00000100:00100000:0.0:1788838077.865418:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255047168 00000100:00100000:0.0:1788838077.865439:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788838077.865444:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1875732255047040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838077.865475:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1875732255047040:12345-0@lo:400:kworker.0 Request processed in 30us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838077.865480:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788838077.865490:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788838077.865509:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1875732255047168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838077.865549:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1875732255047168:12345-0@lo:400:kworker.0 Request processed in 54us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838077.865555:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788838077.865576:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788838077.865600:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a46ed22a00 x1875732255047168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838077.865611:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732255047168:0@lo:400:kworker.0 00000100:00100000:0.0:1788838077.865630:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3272:1875732255046656:0@lo:400:kworker.0 00010000:00080000:0.0:1788838077.865640:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a46ed20700 x1875732255047040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838077.865648:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3272:1875732255047040:0@lo:400:kworker.0 00000100:00100000:2.0:1788838077.866081:0:3270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3270:1875732255046784:0@lo:8:kworker.0 00000100:00100000:2.0:1788838077.866136:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838077.866175:0:3270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3270:1875732255046912:0@lo:8:kworker.0 00000100:00100000:2.0:1788838077.866223:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838077.866258:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255046784 00000100:00100000:2.0:1788838077.866263:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255046784 00000100:00100000:2.0:1788838077.866298:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255046912 00000100:00100000:2.0:1788838077.866302:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255046912 00000100:00100000:2.0:1788838077.866313:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788838077.866318:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3270:x1875732255046784:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788838077.866340:0:15028:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 457 last 0 00000020:00000080:2.0:1788838077.866366:0:15028:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2deb895b363e74c8 00002000:00100000:2.0:1788838077.866379:0:15028:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff97a47baf3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113975 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788838077.866383:0:15028:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788838077.866386:0:15028:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788838077.866726:0:15028:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788838077.866750:0:15028:0:(import.c:65:import_set_state_nolock()) ffff97a47baf4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788838077.866797:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3270:x1875732255046784:12345-0@lo:8:kworker.0 Request processed in 476us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838077.866820:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788838077.866837:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788838077.866841:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3270:x1875732255046912:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788838077.866861:0:15028:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838077.866891:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3270:x1875732255046912:12345-0@lo:8:kworker.0 Request processed in 48us (688us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838077.866897:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788838077.866930:0:3270:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a46ed23b80 x1875732255046784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788838097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838077.866939:0:3270:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788838077.866946:0:3270:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788838077.866954:0:3270:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788838077.866959:0:3270:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788838077.866961:0:3270:0:(import.c:65:import_set_state_nolock()) ffff97a44a41f800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788838077.866974:0:3270:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788838077.866979:0:3270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3270:1875732255046784:0@lo:8:kworker.0 00000100:00080000:2.0:1788838077.866990:0:3270:0:(import.c:65:import_set_state_nolock()) ffff97a4712dc800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838077.866994:0:3270:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838077.866997:0:3270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3270:1875732255046912:0@lo:8:kworker.0 00000004:00080000:2.0:1788838077.867049:0:14363:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1788838077.867069:0:14363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed7a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14363:1875732255047424:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788838077.867096:0:14363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838077.867111:0:14363:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a449e7d180 going to sleep for 11 seconds 00000100:00100000:2.0:1788838077.867124:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255047296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788838077.867150:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838077.867190:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255047424 00000100:00100000:2.0:1788838077.867195:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255047424 00000100:00100000:2.0:1788838077.867247:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788838077.867261:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14363:x1875732255047424:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788838077.869468:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255047296 00000100:00100000:1.0:1788838077.869479:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255047296 00000100:00100000:1.0:1788838077.869535:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788838077.869545:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3274:x1875732255047296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788838077.869578:0:15030:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788838077.869656:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3274:x1875732255047296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (2505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838077.869663:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788838077.872102:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788838077.872166:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a46ed7b100 x1875732255047296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838093 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838077.872194:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255047296:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1788838077.872596:0:14362:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788838077.872918:0:14362:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 457966714122ns, next at 0ns, rc = 0 00002000:00080000:2.0:1788838077.876036:0:15028:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788838077.876047:0:15028:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1788838077.876052:0:15028:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:2.0:1788838077.917628:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788838077.917732:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9072863/0x2deb895b363e74cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.917755:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1788838077.917761:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838077.917770:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9072863/0x2deb895b363e74cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.917792:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9072863/0x2deb895b363e74cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.917804:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9072863/0x2deb895b363e74cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.917815:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9072863/0x2deb895b363e74cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.918409:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788838077.920588:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788838077.920616:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0fec911/0x2deb895b363e74d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.920649:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1788838077.920655:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838077.920664:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0fec911/0x2deb895b363e74d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.920683:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0fec911/0x2deb895b363e74d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.920697:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0fec911/0x2deb895b363e74d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.920706:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0fec911/0x2deb895b363e74d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.920711:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838077.920730:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9072863/0x2deb895b363e74cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.920747:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4800 already unused, calling callback (ffffffffc1616420) 00010000:00010000:1.0:1788838077.920754:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9072863/0x2deb895b363e74cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.920766:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9072863/0x2deb895b363e74cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.920796:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9072863/0x2deb895b363e74cf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.920805:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9072863/0x2deb895b363e74cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.920833:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838077.920835:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838077.920848:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838077.921021:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838077.922099:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838077.922112:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0fec911/0x2deb895b363e74d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.922126:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5e00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:1.0:1788838077.922130:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0fec911/0x2deb895b363e74d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.922139:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0fec911/0x2deb895b363e74d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.922156:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0fec911/0x2deb895b363e74d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.922163:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0fec911/0x2deb895b363e74d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.922186:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838077.922188:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838077.922189:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788838077.923424:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788838077.923439:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd9387b3/0x2deb895b363e74dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.923457:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1788838077.923462:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838077.923468:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd9387b3/0x2deb895b363e74dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.923484:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd9387b3/0x2deb895b363e74dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.923508:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd9387b3/0x2deb895b363e74dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.923516:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd9387b3/0x2deb895b363e74dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.923900:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838077.924240:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838077.924250:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd9387b3/0x2deb895b363e74dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.924261:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4e00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:1.0:1788838077.924276:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd9387b3/0x2deb895b363e74dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.924299:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd9387b3/0x2deb895b363e74dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.924329:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd9387b3/0x2deb895b363e74dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.924338:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd9387b3/0x2deb895b363e74dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.924364:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838077.924366:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838077.924368:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788838077.937300:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788838077.937624:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a72fd365/0x2deb895b363e74e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.937649:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1788838077.937655:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838077.937664:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a72fd365/0x2deb895b363e74e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.937683:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a72fd365/0x2deb895b363e74e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.937695:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a72fd365/0x2deb895b363e74e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.937703:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a72fd365/0x2deb895b363e74e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.937743:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788838077.940713:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788838077.940731:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005424f9fc/0x2deb895b363e74eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.940754:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1788838077.940759:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838077.940766:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005424f9fc/0x2deb895b363e74eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.940781:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005424f9fc/0x2deb895b363e74eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.940793:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005424f9fc/0x2deb895b363e74eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.940801:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005424f9fc/0x2deb895b363e74eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.940835:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788838077.941994:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788838077.942007:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a72fd365/0x2deb895b363e74e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.942020:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4600 already unused, calling callback (ffffffffc1616420) 00010000:00010000:1.0:1788838077.942026:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a72fd365/0x2deb895b363e74e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.942038:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a72fd365/0x2deb895b363e74e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.942062:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a72fd365/0x2deb895b363e74e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.942086:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a72fd365/0x2deb895b363e74e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.944020:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838077.944035:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005424f9fc/0x2deb895b363e74eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.944049:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4a00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:1.0:1788838077.944055:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005424f9fc/0x2deb895b363e74eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.944067:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005424f9fc/0x2deb895b363e74eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.944092:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005424f9fc/0x2deb895b363e74eb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.944100:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005424f9fc/0x2deb895b363e74eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.944133:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838077.944136:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838077.944143:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838077.944832:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788838077.945971:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788838077.945985:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d4f5747/0x2deb895b363e74f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.946006:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1788838077.946019:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838077.946027:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d4f5747/0x2deb895b363e74f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.946044:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d4f5747/0x2deb895b363e74f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.946056:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d4f5747/0x2deb895b363e74f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.946064:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d4f5747/0x2deb895b363e74f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.946086:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838077.946674:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838077.946684:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d4f5747/0x2deb895b363e74f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.946702:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5c00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:1.0:1788838077.946707:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d4f5747/0x2deb895b363e74f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.946717:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d4f5747/0x2deb895b363e74f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.946738:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d4f5747/0x2deb895b363e74f2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.946747:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d4f5747/0x2deb895b363e74f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.946769:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838077.946770:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838077.946772:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788838077.947574:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788838077.947586:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000210719c7/0x2deb895b363e74f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.947611:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1788838077.947616:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838077.947623:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000210719c7/0x2deb895b363e74f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.947635:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000210719c7/0x2deb895b363e74f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.947644:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000210719c7/0x2deb895b363e74f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.947659:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000210719c7/0x2deb895b363e74f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.947677:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788838077.948535:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788838077.948544:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb88c4be/0x2deb895b363e7500 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.948557:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1788838077.948561:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838077.948565:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb88c4be/0x2deb895b363e7500 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.948576:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb88c4be/0x2deb895b363e7500 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.948584:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb88c4be/0x2deb895b363e7500 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.948591:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb88c4be/0x2deb895b363e7500 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.949030:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838077.949042:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000210719c7/0x2deb895b363e74f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.949052:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4c00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:1.0:1788838077.949057:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000210719c7/0x2deb895b363e74f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.949067:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000210719c7/0x2deb895b363e74f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.949098:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000210719c7/0x2deb895b363e74f9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.949105:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000210719c7/0x2deb895b363e74f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.949143:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838077.949145:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838077.949147:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838077.964058:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838077.964090:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838077.964103:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb88c4be/0x2deb895b363e7500 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.965242:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5600 already unused, calling callback (ffffffffc1616420) 00010000:00010000:2.0:1788838077.965249:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb88c4be/0x2deb895b363e7500 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.965262:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb88c4be/0x2deb895b363e7500 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.965300:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb88c4be/0x2deb895b363e7500 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.965309:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb88c4be/0x2deb895b363e7500 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.965339:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838077.965341:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838077.965344:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788838077.974357:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788838077.974373:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090e0d76a/0x2deb895b363e7507 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.974395:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1788838077.974400:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838077.974408:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090e0d76a/0x2deb895b363e7507 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.974424:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090e0d76a/0x2deb895b363e7507 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.974446:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090e0d76a/0x2deb895b363e7507 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.974454:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090e0d76a/0x2deb895b363e7507 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.974474:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838077.975693:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838077.975708:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090e0d76a/0x2deb895b363e7507 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.975722:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4400 already unused, calling callback (ffffffffc1616420) 00010000:00010000:1.0:1788838077.975728:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090e0d76a/0x2deb895b363e7507 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.975739:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090e0d76a/0x2deb895b363e7507 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.975764:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090e0d76a/0x2deb895b363e7507 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.975772:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090e0d76a/0x2deb895b363e7507 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.975818:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838077.975820:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838077.975822:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788838077.979857:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788838077.979873:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bea8b964/0x2deb895b363e750e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.981109:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1788838077.981116:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838077.981125:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bea8b964/0x2deb895b363e750e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.981145:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bea8b964/0x2deb895b363e750e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.981157:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bea8b964/0x2deb895b363e750e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.981167:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bea8b964/0x2deb895b363e750e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.981237:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838077.981400:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838077.981416:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bea8b964/0x2deb895b363e750e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.981433:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5800 already unused, calling callback (ffffffffc1616420) 00010000:00010000:0.0:1788838077.981439:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bea8b964/0x2deb895b363e750e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.981451:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bea8b964/0x2deb895b363e750e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.981495:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bea8b964/0x2deb895b363e750e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.981504:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bea8b964/0x2deb895b363e750e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.981535:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838077.981537:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838077.981544:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788838077.982312:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788838077.982322:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb88c4be/0x2deb895b363e7515 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.982334:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1788838077.982338:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838077.982344:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb88c4be/0x2deb895b363e7515 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.982355:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb88c4be/0x2deb895b363e7515 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.982364:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb88c4be/0x2deb895b363e7515 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.982371:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb88c4be/0x2deb895b363e7515 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838077.982393:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838077.982807:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838077.982819:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb88c4be/0x2deb895b363e7515 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.982831:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5600 already unused, calling callback (ffffffffc1616420) 00010000:00010000:0.0:1788838077.982835:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb88c4be/0x2deb895b363e7515 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.982846:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb88c4be/0x2deb895b363e7515 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.982863:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb88c4be/0x2deb895b363e7515 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.982870:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb88c4be/0x2deb895b363e7515 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.982912:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838077.982913:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838077.982915:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838077.988805:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788838077.988821:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9267447/0x2deb895b363e751c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.988839:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788838077.988844:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838077.988851:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9267447/0x2deb895b363e751c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.988866:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9267447/0x2deb895b363e751c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.988877:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9267447/0x2deb895b363e751c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.988885:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9267447/0x2deb895b363e751c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.988904:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788838077.989495:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788838077.989502:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b25ba15/0x2deb895b363e7523 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.989524:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788838077.989528:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838077.989533:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b25ba15/0x2deb895b363e7523 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.989543:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b25ba15/0x2deb895b363e7523 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.989551:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b25ba15/0x2deb895b363e7523 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.989559:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b25ba15/0x2deb895b363e7523 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.989573:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788838077.991724:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788838077.991739:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f1a944b/0x2deb895b363e752a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.991754:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788838077.991759:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838077.991766:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f1a944b/0x2deb895b363e752a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.991781:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f1a944b/0x2deb895b363e752a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.991803:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f1a944b/0x2deb895b363e752a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.991811:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f1a944b/0x2deb895b363e752a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.991825:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788838077.992455:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788838077.992463:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d8653e1/0x2deb895b363e7531 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.992473:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788838077.992477:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838077.992483:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d8653e1/0x2deb895b363e7531 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.992493:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d8653e1/0x2deb895b363e7531 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.992501:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d8653e1/0x2deb895b363e7531 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.992509:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d8653e1/0x2deb895b363e7531 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.992530:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788838077.995896:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788838077.995911:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2a0859a/0x2deb895b363e7538 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.995927:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788838077.995933:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838077.995939:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2a0859a/0x2deb895b363e7538 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.995952:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2a0859a/0x2deb895b363e7538 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.995961:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2a0859a/0x2deb895b363e7538 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.995969:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2a0859a/0x2deb895b363e7538 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.995981:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788838077.996771:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788838077.996778:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bf39bd3/0x2deb895b363e753f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.996788:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788838077.996797:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838077.996803:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bf39bd3/0x2deb895b363e753f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.996812:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bf39bd3/0x2deb895b363e753f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.996820:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bf39bd3/0x2deb895b363e753f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.996827:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bf39bd3/0x2deb895b363e753f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.996836:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1788838077.997743:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788838077.997754:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9267447/0x2deb895b363e751c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.997766:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e790800 already unused, calling callback (ffffffffc1616420) 00010000:00010000:1.0:1788838077.997770:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9267447/0x2deb895b363e751c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.997779:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9267447/0x2deb895b363e751c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.998167:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9267447/0x2deb895b363e751c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.998176:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9267447/0x2deb895b363e751c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.998198:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788838077.998231:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b25ba15/0x2deb895b363e7523 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.998238:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e791000 already unused, calling callback (ffffffffc1616420) 00010000:00010000:1.0:1788838077.998247:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b25ba15/0x2deb895b363e7523 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.998255:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b25ba15/0x2deb895b363e7523 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.998276:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b25ba15/0x2deb895b363e7523 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.998283:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b25ba15/0x2deb895b363e7523 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.998294:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788838077.998298:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f1a944b/0x2deb895b363e752a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.998304:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e790a00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:1.0:1788838077.998307:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f1a944b/0x2deb895b363e752a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.998313:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f1a944b/0x2deb895b363e752a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.998322:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f1a944b/0x2deb895b363e752a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.998329:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f1a944b/0x2deb895b363e752a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.998346:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788838077.998349:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d8653e1/0x2deb895b363e7531 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788838077.998353:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788838077.998356:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e790e00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:1.0:1788838077.998359:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d8653e1/0x2deb895b363e7531 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.998367:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d8653e1/0x2deb895b363e7531 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.998371:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000453d2888/0x2deb895b363e7546 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.998378:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d8653e1/0x2deb895b363e7531 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.998381:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=458s v=(0 0) 00010000:00010000:1.0:1788838077.998384:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d8653e1/0x2deb895b363e7531 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.998385:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838077.998390:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000453d2888/0x2deb895b363e7546 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.998394:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788838077.998398:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2a0859a/0x2deb895b363e7538 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.998400:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000453d2888/0x2deb895b363e7546 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.998404:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e791c00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:1.0:1788838077.998407:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2a0859a/0x2deb895b363e7538 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.998410:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000453d2888/0x2deb895b363e7546 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.998423:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000453d2888/0x2deb895b363e7546 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.998432:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788838077.998440:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2a0859a/0x2deb895b363e7538 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788838077.998881:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788838077.998888:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ad185a4/0x2deb895b363e754d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.998896:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788838077.998900:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838077.998904:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ad185a4/0x2deb895b363e754d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.998914:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ad185a4/0x2deb895b363e754d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.998927:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ad185a4/0x2deb895b363e754d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.998934:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ad185a4/0x2deb895b363e754d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.998942:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788838077.998984:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2a0859a/0x2deb895b363e7538 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.998991:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2a0859a/0x2deb895b363e7538 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.999004:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788838077.999008:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bf39bd3/0x2deb895b363e753f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.999014:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e791200 already unused, calling callback (ffffffffc1616420) 00010000:00010000:1.0:1788838077.999017:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bf39bd3/0x2deb895b363e753f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.999024:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bf39bd3/0x2deb895b363e753f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.999035:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bf39bd3/0x2deb895b363e753f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.999042:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bf39bd3/0x2deb895b363e753f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.999066:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788838077.999069:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000453d2888/0x2deb895b363e7546 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.999076:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e791800 already unused, calling callback (ffffffffc1616420) 00010000:00010000:1.0:1788838077.999079:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000453d2888/0x2deb895b363e7546 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.999086:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000453d2888/0x2deb895b363e7546 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.999096:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000453d2888/0x2deb895b363e7546 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.999104:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000453d2888/0x2deb895b363e7546 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.999114:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838077.999117:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ad185a4/0x2deb895b363e754d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.999123:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e791400 already unused, calling callback (ffffffffc1616420) 00010000:00010000:1.0:1788838077.999126:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ad185a4/0x2deb895b363e754d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.999145:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ad185a4/0x2deb895b363e754d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.999155:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ad185a4/0x2deb895b363e754d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.999162:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ad185a4/0x2deb895b363e754d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838077.999173:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838077.999174:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838077.999177:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838077.999190:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838077.999375:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788838077.999380:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e589142/0x2deb895b363e7554 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.999393:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788838077.999395:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838077.999399:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e589142/0x2deb895b363e7554 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.999408:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e589142/0x2deb895b363e7554 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.999416:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e589142/0x2deb895b363e7554 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.999423:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e589142/0x2deb895b363e7554 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.999439:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838077.999447:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838077.999451:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e589142/0x2deb895b363e7554 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.999458:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e791600 already unused, calling callback (ffffffffc1616420) 00010000:00010000:0.0:1788838077.999462:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e589142/0x2deb895b363e7554 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.999469:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e589142/0x2deb895b363e7554 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.999491:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e589142/0x2deb895b363e7554 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838077.999811:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e589142/0x2deb895b363e7554 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.004357:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838078.004365:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838078.004373:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838078.013444:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788838078.013458:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d116c62c/0x2deb895b363e755b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.013476:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=458s v=(0 0) 00010000:00010000:1.0:1788838078.013481:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838078.013488:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d116c62c/0x2deb895b363e755b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.013512:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d116c62c/0x2deb895b363e755b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.013521:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d116c62c/0x2deb895b363e755b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.013543:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d116c62c/0x2deb895b363e755b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.013563:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788838078.014159:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788838078.014166:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce15286d/0x2deb895b363e7562 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.014175:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=458s v=(0 0) 00010000:00010000:1.0:1788838078.014178:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838078.014182:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce15286d/0x2deb895b363e7562 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.014190:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce15286d/0x2deb895b363e7562 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.014197:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce15286d/0x2deb895b363e7562 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.014227:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce15286d/0x2deb895b363e7562 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.014238:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788838078.014246:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788838078.014254:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d116c62c/0x2deb895b363e755b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.014263:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3d400 already unused, calling callback (ffffffffc1616420) 00010000:00010000:0.0:1788838078.014279:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d116c62c/0x2deb895b363e755b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.014289:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d116c62c/0x2deb895b363e755b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.014307:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d116c62c/0x2deb895b363e755b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.014315:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d116c62c/0x2deb895b363e755b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.014344:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838078.014347:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce15286d/0x2deb895b363e7562 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.014355:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3ca00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:0.0:1788838078.014358:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce15286d/0x2deb895b363e7562 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.014366:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce15286d/0x2deb895b363e7562 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.014376:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce15286d/0x2deb895b363e7562 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.014383:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce15286d/0x2deb895b363e7562 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.014395:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838078.014397:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838078.014399:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838078.014625:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788838078.014632:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025b6e2ca/0x2deb895b363e7569 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.014647:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=458s v=(0 0) 00010000:00010000:1.0:1788838078.014650:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838078.014654:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025b6e2ca/0x2deb895b363e7569 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.014663:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025b6e2ca/0x2deb895b363e7569 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.014672:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025b6e2ca/0x2deb895b363e7569 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.014679:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025b6e2ca/0x2deb895b363e7569 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.014701:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788838078.015092:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788838078.015098:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f48c5d6/0x2deb895b363e7570 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.015107:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=458s v=(0 0) 00010000:00010000:1.0:1788838078.015110:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838078.015115:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f48c5d6/0x2deb895b363e7570 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.015124:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f48c5d6/0x2deb895b363e7570 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.015143:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f48c5d6/0x2deb895b363e7570 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.015150:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f48c5d6/0x2deb895b363e7570 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.015158:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788838078.015491:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788838078.015498:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025b6e2ca/0x2deb895b363e7569 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.015505:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3cc00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:0.0:1788838078.015515:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025b6e2ca/0x2deb895b363e7569 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.015524:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025b6e2ca/0x2deb895b363e7569 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.015536:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025b6e2ca/0x2deb895b363e7569 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.015543:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025b6e2ca/0x2deb895b363e7569 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.015557:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838078.015561:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f48c5d6/0x2deb895b363e7570 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.015567:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3da00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:0.0:1788838078.015570:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f48c5d6/0x2deb895b363e7570 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788838078.015577:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788838078.015577:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f48c5d6/0x2deb895b363e7570 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.015582:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5f80a92/0x2deb895b363e7577 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.015587:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f48c5d6/0x2deb895b363e7570 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.015590:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=458s v=(0 0) 00010000:00010000:1.0:1788838078.015594:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838078.015595:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f48c5d6/0x2deb895b363e7570 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.015598:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5f80a92/0x2deb895b363e7577 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.015607:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5f80a92/0x2deb895b363e7577 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.015613:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838078.015615:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5f80a92/0x2deb895b363e7577 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.015615:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838078.015617:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838078.015622:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5f80a92/0x2deb895b363e7577 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.015651:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838078.015720:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838078.015725:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5f80a92/0x2deb895b363e7577 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.015732:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3c200 already unused, calling callback (ffffffffc1616420) 00010000:00010000:0.0:1788838078.015736:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5f80a92/0x2deb895b363e7577 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.015744:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5f80a92/0x2deb895b363e7577 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.015755:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5f80a92/0x2deb895b363e7577 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.015762:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5f80a92/0x2deb895b363e7577 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.015775:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838078.015777:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838078.015778:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838078.016011:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788838078.017677:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788838078.017888:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788838078.017896:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca392229/0x2deb895b363e757e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.017912:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=458s v=(0 0) 00010000:00010000:1.0:1788838078.017916:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838078.017921:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca392229/0x2deb895b363e757e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.017932:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca392229/0x2deb895b363e757e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.017941:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca392229/0x2deb895b363e757e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.017948:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca392229/0x2deb895b363e757e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.017969:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838078.018164:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838078.018171:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca392229/0x2deb895b363e757e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.018186:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3dc00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:0.0:1788838078.018190:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca392229/0x2deb895b363e757e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.018198:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca392229/0x2deb895b363e757e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.018231:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca392229/0x2deb895b363e757e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.018239:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca392229/0x2deb895b363e757e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.018256:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838078.018257:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838078.018259:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838078.018442:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788838078.018448:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083c7ef4f/0x2deb895b363e7585 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.018680:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=458s v=(0 0) 00010000:00010000:1.0:1788838078.018690:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838078.018695:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083c7ef4f/0x2deb895b363e7585 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.018705:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083c7ef4f/0x2deb895b363e7585 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.018712:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083c7ef4f/0x2deb895b363e7585 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.018720:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083c7ef4f/0x2deb895b363e7585 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838078.018741:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788838078.018929:0:15028:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1788838078.019026:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14363:x1875732255047424:12345-0@lo:5:osp-pre-0-0.0 Request processed in 151763us (151925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838078.019039:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788838078.019240:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838078.019247:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083c7ef4f/0x2deb895b363e7585 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.019255:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3d800 already unused, calling callback (ffffffffc1616420) 00010000:00010000:0.0:1788838078.019259:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083c7ef4f/0x2deb895b363e7585 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.019276:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083c7ef4f/0x2deb895b363e7585 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.019295:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083c7ef4f/0x2deb895b363e7585 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.019302:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083c7ef4f/0x2deb895b363e7585 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.019317:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838078.019319:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838078.019321:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838078.020328:0:14363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed7a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14363:1875732255047424:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788838078.020347:0:14363:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:0.0:1788838078.020394:0:14363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed20700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14363:1875732255047552:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788838078.020442:0:14363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838078.020504:0:14363:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f97300 going to sleep for 11 seconds 00000100:00100000:1.0:1788838078.020673:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255047552 00000100:00100000:1.0:1788838078.020681:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255047552 00000100:00100000:1.0:1788838078.020727:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788838078.020737:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14363:x1875732255047552:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788838078.020777:0:15029:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1788838078.038545:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14363:x1875732255047552:12345-0@lo:5:osp-pre-0-0.0 Request processed in 17797us (18090us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788838078.038565:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788838078.038841:0:14363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed20700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14363:1875732255047552:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788838078.038860:0:14363:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1788838078.893404:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788838079.105275:0:15396:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788838079.910865:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788838080.364622:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788838080.364645:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:1.0:1788838080.937046:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838081.955384:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838082.982358:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788838083.234996:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788838083.235007:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788838083.235012:0:36:0:(import.c:65:import_set_state_nolock()) ffff97a4712dc800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838083.235024:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 457 00000100:00080000:3.0:1788838083.235032:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788838083.235040:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97a4712dc800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788838083.235079:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a47b853480 x1875732255047936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788838083.235150:0:3270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3270:1875732255047936:0@lo:8:kworker.0 00000100:00100000:3.0:1788838083.235175:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255047808:0@lo:400:kworker.0 00000100:00100000:0.0:1788838083.235234:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3271:1875732255047680:0@lo:400:kworker.0 00000100:00100000:2.0:1788838083.236788:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732255048064:0@lo:400:kworker.0 00000100:00100000:3.0:1788838083.237014:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838083.237566:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838083.237641:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b09b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255048320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788838083.237698:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838083.237721:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3274:1875732255048192:0@lo:400:kworker.0 00000100:00100000:0.0:1788838083.237746:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255047680 00000100:00100000:0.0:1788838083.237757:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255047680 00000100:00100000:1.0:1788838083.237772:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838083.237828:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788838083.237835:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255048192 00000100:00100000:1.0:1788838083.237841:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255048192 00000100:00100000:0.0:1788838083.237842:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a460089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+16:3271:x1875732255047680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838083.237891:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788838083.237900:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1875732255048192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838083.237916:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a460089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+16:3271:x1875732255047680:12345-0@lo:400:kworker.0 Request processed in 75us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838083.237925:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788838083.237947:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1875732255048192:12345-0@lo:400:kworker.0 Request processed in 48us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838083.237955:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788838083.237975:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255048320 00000100:00100000:1.0:1788838083.237979:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255048320 00000100:00100000:1.0:1788838083.238003:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788838083.238009:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255048320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788838083.238045:0:15030:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788838083.238078:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255048320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838083.238085:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788838083.238126:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788838083.238127:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a47b853800 x1875732255048192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788838083.238134:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788838083.238150:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3274:1875732255048192:0@lo:400:kworker.0 00000100:00100000:0.0:1788838083.238179:0:3271:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788838083.238230:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b09b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255048320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788838083.238288:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3271:1875732255047680:0@lo:400:kworker.0 00000100:00100000:0.0:1788838083.238842:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838083.238917:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838083.239008:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255047808 00000100:00100000:3.0:1788838083.239016:0:15027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255047808 00000100:00100000:3.0:1788838083.239053:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255047936 00000100:00100000:3.0:1788838083.239057:0:15027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255047936 00000100:00100000:2.0:1788838083.239093:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788838083.239117:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b851f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255047808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838083.239141:0:15027:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788838083.239151:0:15027:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788838083.239187:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b851f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255047808:12345-0@lo:400:kworker.0 Request processed in 74us (2174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838083.239196:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788838083.239235:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788838083.239239:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3270:x1875732255047936:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788838083.239260:0:15029:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838083.239334:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255047808:0@lo:400:kworker.0 00000100:00100000:0.0:1788838083.239807:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255048064 00000100:00100000:0.0:1788838083.239814:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255048064 00000100:00100000:0.0:1788838083.239848:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788838083.239855:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732255048064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838083.239909:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732255048064:12345-0@lo:400:kworker.0 Request processed in 54us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838083.239916:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788838083.240541:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a47b851880 x1875732255048064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838083.240569:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732255048064:0@lo:400:kworker.0 00000100:00100000:1.0:1788838083.260770:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3270:x1875732255047936:12345-0@lo:8:kworker.0 Request processed in 21518us (21920us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838083.260798:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788838083.260916:0:3270:0:(import.c:65:import_set_state_nolock()) ffff97a4712dc800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838083.260935:0:3270:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788838083.260941:0:3270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3270:1875732255047936:0@lo:8:kworker.0 00010000:00010000:3.0:1788838084.003781:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788838084.642930:0:14371:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788838085.030307:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838086.058636:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838087.079516:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788838087.203420:0:15748:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788838087.203439:0:15748:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788838087.203610:0:15748:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97a4474f5800 00000020:01000004:0.0:1788838087.203634:0:15748:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788838087.203652:0:15748:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788838087.203672:0:15748:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff97a458ce4d28) 00000020:00000080:0.0:1788838087.203692:0:15748:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788838087.244785:0:15748:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788838087.245100:0:15748:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788838087.246163:0:15748:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788838087.246569:0:15748:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788838087.247030:0:15748:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788838087.247679:0:15748:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 453: rc = 0 00100000:10000000:3.0:1788838087.247795:0:15748:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 453: rc = 0 00100000:10000000:3.0:1788838087.247897:0:15748:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 453: rc = 0 00100000:10000000:3.0:1788838087.248877:0:15748:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 555: rc = 0 00100000:10000000:3.0:1788838087.249383:0:15748:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 555: rc = 0 00100000:10000000:3.0:1788838087.249694:0:15748:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 555: rc = 0 00100000:10000000:3.0:1788838087.249943:0:15748:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 555: rc = 0 00100000:10000000:3.0:1788838087.250436:0:15748:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 555: rc = 0 00100000:10000000:3.0:1788838087.250754:0:15748:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 555: rc = 0 00000020:00000080:3.0:1788838087.251571:0:15748:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788838087.251588:0:15748:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788838087.251602:0:15748:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2deb895b363e7593 00000020:01000004:3.0:1788838087.254423:0:15748:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788838087.254481:0:15748:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.154@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788838087.254487:0:15748:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788838087.254498:0:15748:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788838087.254543:0:15748:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788838087.254549:0:15748:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788838087.276114:0:15748:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788838087.276168:0:15748:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.154@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788838087.276174:0:15748:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788838087.276177:0:15748:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788838087.276178:0:15748:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838087.276179:0:15748:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838087.276181:0:15748:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838087.276287:0:15748:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838087.276289:0:15748:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788838087.276291:0:15748:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838087.276293:0:15748:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788838087.276298:0:15748:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788838087.276302:0:15748:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788838087.276303:0:15748:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788838087.276305:0:15748:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838087.276306:0:15748:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838087.276307:0:15748:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838087.276309:0:15748:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838087.276310:0:15748:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788838087.276311:0:15748:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838087.276312:0:15748:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788838087.276344:0:15748:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788838087.276371:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255048448:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788838087.276468:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838087.276535:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4601b2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788838087.276731:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255048448 00000100:00100000:0.0:1788838087.276743:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255048448 00000100:00100000:0.0:1788838087.276824:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788838087.276837:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a460088c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+16:15748:x1875732255048448:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788838087.276900:0:14333:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788838087.276905:0:14333:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788838087.276910:0:14333:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788838087.311712:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a460088c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+16:15748:x1875732255048448:12345-0@lo:253:mount.lustre.0 Request processed in 34861us (35228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838087.311731:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788838087.311846:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255048448:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788838087.311869:0:15748:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788838087.311874:0:15748:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788838087.311876:0:15748:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788838087.311877:0:15748:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838087.311878:0:15748:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838087.311880:0:15748:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838087.311881:0:15748:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838087.311882:0:15748:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788838087.311884:0:15748:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838087.311886:0:15748:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788838087.311917:0:15748:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97a4474f5800 from lustre-OST0001 10000000:01000000:2.0:1788838087.311958:0:15748:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788838087.311961:0:15748:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788838087.311971:0:15748:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97a46ec64d28 local copy 00010000:00010000:2.0:1788838087.311985:0:15748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48ac00/0x2deb895b363e7340 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e7347 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838087.313408:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255048576:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788838087.313486:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838087.313768:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a461755600 going to sleep for 11 seconds 00000100:00100000:0.0:1788838087.313875:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255048576 00000100:00100000:0.0:1788838087.313885:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255048576 00000100:00100000:0.0:1788838087.314044:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788838087.314056:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a460089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+16:15748:x1875732255048576:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838087.314372:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a460089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+16:15748:x1875732255048576:12345-0@lo:501:mount.lustre.0 Request processed in 317us (885us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788838087.314380:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788838087.314484:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255048576:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788838087.314514:0:15748:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788838087.314699:0:15748:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788838087.314710:0:15748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48ac00/0x2deb895b363e7340 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e7347 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838087.314722:0:15748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a44a48ac00/0x2deb895b363e7340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e7347 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838087.314754:0:15748:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97a4474f5800 10000000:01000000:3.0:1788838087.314760:0:15748:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788838087.314767:0:15748:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788838087.314770:0:15748:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788838087.314775:0:15748:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788838087.314779:0:15748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788838087.314814:0:15748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48a600/0x2deb895b363e759a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838087.314823:0:15748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a44a48a600/0x2deb895b363e759a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838087.314839:0:15748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a44a48a600/0x2deb895b363e759a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838087.314860:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b851880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255048704:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788838087.314895:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838087.314942:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f01cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838087.314970:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255048704 00000100:00100000:0.0:1788838087.314976:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255048704 00000100:00100000:0.0:1788838087.315046:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788838087.315055:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a460088050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+16:15748:x1875732255048704:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838087.315068:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838087.315094:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a46e791c00/0x2deb895b363e75a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e759a expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838087.315122:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a46e791c00/0x2deb895b363e75a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e759a expref: 17 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838087.315143:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a46e791c00/0x2deb895b363e75a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e759a expref: 17 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838087.315153:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e791c00, rc 0) 00000100:00100000:0.0:1788838087.315197:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a460088050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+17:15748:x1875732255048704:12345-0@lo:101:mount.lustre.0 Request processed in 143us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838087.315233:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788838087.315310:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b851880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255048704:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788838087.315326:0:15748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a44a48a600/0x2deb895b363e759a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e75a1 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838087.315335:0:15748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a44a48a600/0x2deb895b363e759a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e75a1 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788838087.316062:0:15748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788838087.317044:0:15748:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788838087.317439:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788838087.317490:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788838087.317524:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788838087.317574:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788838087.317611:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788838087.317644:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788838087.317715:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788838087.317723:0:15748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788838087.317833:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b851880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255048832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838087.317916:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838087.320783:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f01780 going to sleep for 11 seconds 00000100:00100000:2.0:1788838087.321067:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255048832 00000100:00100000:2.0:1788838087.321082:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255048832 00000100:00100000:1.0:1788838087.321155:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788838087.321174:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46008bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+17:15748:x1875732255048832:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788838087.323376:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46008bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+17:15748:x1875732255048832:12345-0@lo:501:mount.lustre.0 Request processed in 2201us (5454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838087.323392:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788838087.323811:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b851880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255048832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838087.323886:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b851880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255048960:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788838087.323952:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838087.324000:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f01780 going to sleep for 11 seconds 00000100:00100000:2.0:1788838087.324066:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255048960 00000100:00100000:2.0:1788838087.324075:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255048960 00000100:00100000:2.0:1788838087.324143:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788838087.324154:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a460088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+17:15748:x1875732255048960:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788838087.325041:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a460088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+17:15748:x1875732255048960:12345-0@lo:503:mount.lustre.0 Request processed in 884us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838087.325062:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788838087.328628:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b851880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255048960:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788838087.332047:0:15748:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788838087.332237:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b851880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255049088:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788838087.333064:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838087.333249:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f01780 going to sleep for 11 seconds 00000100:00100000:2.0:1788838087.336657:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255049088 00000100:00100000:2.0:1788838087.336676:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255049088 00000100:00100000:2.0:1788838087.336809:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788838087.336821:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46008b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+17:15748:x1875732255049088:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788838087.337290:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46008b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+17:15748:x1875732255049088:12345-0@lo:502:mount.lustre.0 Request processed in 470us (4230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838087.337299:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788838087.338816:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b851880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255049088:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788838087.339255:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788838087.340749:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788838087.340791:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788838087.340858:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788838087.340895:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788838087.340929:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788838087.340978:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788838087.341016:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788838087.341103:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1788838087.341170:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b851880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255049216:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788838087.341311:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838087.341376:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f01780 going to sleep for 11 seconds 00000100:00100000:2.0:1788838087.344167:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255049216 00000100:00100000:2.0:1788838087.344187:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255049216 00000100:00100000:2.0:1788838087.344318:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788838087.344331:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46008b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+17:15748:x1875732255049216:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788838087.344718:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46008b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+17:15748:x1875732255049216:12345-0@lo:502:mount.lustre.0 Request processed in 388us (3405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838087.344727:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788838087.345175:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b851880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255049216:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788838087.345458:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1788838087.345477:0:15748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1788838087.349476:0:15749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788838087.349501:0:15749:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788838087.349513:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838087.349516:0:15749:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788838087.349526:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788838087.349549:0:15749:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff97a46ec63370) 00000020:00000080:2.0:1788838087.349579:0:15749:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788838087.349586:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788838087.349668:0:15749:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a4474f5800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788838087.349678:0:15749:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788838087.349687:0:15749:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2deb895b363e75af 00010000:00010000:3.0:1788838087.364641:0:15749:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1788838087.365392:0:15749:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1788838087.370669:0:15749:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788838087.374420:0:15749:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788838087.374437:0:15749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838087.374446:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838087.374448:0:15749:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788838087.374454:0:15749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838087.374458:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838087.374459:0:15749:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788838087.374462:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788838087.374464:0:15749:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788838087.374466:0:15749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838087.374468:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838087.374469:0:15749:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788838087.374471:0:15749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838087.374474:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838087.374475:0:15749:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788838087.374478:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788838087.374562:0:15749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838087.374566:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838087.374567:0:15749:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788838087.374571:0:15749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788838087.378051:0:15748:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788838087.378121:0:15748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788838087.378153:0:15748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48a600/0x2deb895b363e759a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e75a1 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838087.378168:0:15748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a44a48a600/0x2deb895b363e759a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e75a1 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838087.378198:0:15748:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a4474f5800 from 1 10000000:01000000:3.0:1788838087.378224:0:15748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788838087.378283:0:15748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48b400/0x2deb895b363e75b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838087.378293:0:15748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a44a48b400/0x2deb895b363e75b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838087.378308:0:15748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a44a48b400/0x2deb895b363e75b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838087.378345:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b851880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255049344:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788838087.382703:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838087.382777:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4672610c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838087.382873:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255049344 00000100:00100000:0.0:1788838087.382887:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255049344 00000100:00100000:0.0:1788838087.382972:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788838087.382984:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46008b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+17:15748:x1875732255049344:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838087.383020:0:14332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838087.383045:0:14332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a46e790e00/0x2deb895b363e75bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e75b6 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838087.383097:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a46e790e00/0x2deb895b363e75bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e75b6 expref: 18 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838087.383111:0:14332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a46e790e00/0x2deb895b363e75bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e75b6 expref: 18 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838087.383122:0:14332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e790e00, rc 0) 00000100:00100000:0.0:1788838087.383181:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46008b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+18:15748:x1875732255049344:12345-0@lo:101:mount.lustre.0 Request processed in 199us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838087.383188:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788838087.383692:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b851880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255049344:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788838087.383718:0:15748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a44a48b400/0x2deb895b363e75b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e75bd expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838087.383729:0:15748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a44a48b400/0x2deb895b363e75b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e75bd expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788838087.384675:0:15748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788838087.385183:0:15748:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788838087.385494:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788838087.385537:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788838087.385592:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788838087.385600:0:15748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788838087.385931:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b851880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255049472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838087.386111:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838087.388684:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4672610c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838087.388811:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255049472 00000100:00100000:0.0:1788838087.388825:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255049472 00000100:00100000:0.0:1788838087.388961:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788838087.388974:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a460088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+18:15748:x1875732255049472:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838087.389390:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a460088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+18:15748:x1875732255049472:12345-0@lo:501:mount.lustre.0 Request processed in 419us (3280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838087.389399:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788838087.393822:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b851880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255049472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838087.393912:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed23100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255049600:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788838087.394132:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838087.394183:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b1ab780 going to sleep for 11 seconds 00000100:00100000:2.0:1788838087.394268:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255049600 00000100:00100000:2.0:1788838087.394277:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255049600 00000100:00100000:2.0:1788838087.394354:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788838087.394365:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44746f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+18:15748:x1875732255049600:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788838087.394629:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44746f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+18:15748:x1875732255049600:12345-0@lo:503:mount.lustre.0 Request processed in 265us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838087.394637:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788838087.397620:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed23100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255049600:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788838087.398898:0:15748:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788838087.399020:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed23100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255049728:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788838087.399148:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838087.399234:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b1ab780 going to sleep for 11 seconds 00000100:00100000:3.0:1788838087.399237:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255049728 00000100:00100000:3.0:1788838087.399248:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255049728 00000100:00100000:3.0:1788838087.399310:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788838087.399322:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44746cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+18:15748:x1875732255049728:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788838087.399570:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44746cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+18:15748:x1875732255049728:12345-0@lo:502:mount.lustre.0 Request processed in 249us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838087.399580:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788838087.402304:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed23100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255049728:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788838087.402732:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788838087.402799:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788838087.402846:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788838087.402881:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788838087.402915:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788838087.402962:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788838087.403008:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788838087.403058:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788838087.403125:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed23100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255049856:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788838087.404641:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838087.404747:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b1ab780 going to sleep for 11 seconds 00000100:00100000:2.0:1788838087.407564:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255049856 00000100:00100000:2.0:1788838087.407588:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255049856 00000100:00100000:3.0:1788838087.407744:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788838087.407756:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44746d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+18:15748:x1875732255049856:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788838087.408178:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44746d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+18:15748:x1875732255049856:12345-0@lo:502:mount.lustre.0 Request processed in 423us (3543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838087.408187:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788838087.408292:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed23100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255049856:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788838087.408515:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788838087.408535:0:15748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788838087.409569:0:15753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838087.409584:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838087.409587:0:15753:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788838087.409595:0:15753:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a4474f5800 00000020:00000080:0.0:1788838087.409598:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788838087.409607:0:15753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838087.409609:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838087.409611:0:15753:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788838087.409614:0:15753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838087.409624:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838087.409625:0:15753:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788838087.409630:0:15753:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a4474f5800 00000020:00000080:0.0:1788838087.409632:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788838087.409758:0:15753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838087.409763:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838087.409764:0:15753:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788838087.409767:0:15753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838087.409769:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838087.409770:0:15753:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788838087.409774:0:15753:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97a4474f5800 00000020:00000080:0.0:1788838087.409776:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788838087.418636:0:15753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838087.418655:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838087.418657:0:15753:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788838087.418665:0:15753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788838087.420278:0:15748:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788838087.420331:0:15748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788838087.420361:0:15748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a44a48b400/0x2deb895b363e75b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e75bd expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838087.420375:0:15748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a44a48b400/0x2deb895b363e75b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e75bd expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838087.420444:0:15748:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788838087.420448:0:15748:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97a4474f5800 10000000:01000000:1.0:1788838087.420452:0:15748:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97a4474f5800 10000000:01000000:1.0:1788838087.420457:0:15748:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788838087.420465:0:15748:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97a4474f5800 from 1 10000000:01000000:1.0:1788838087.420469:0:15748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788838087.420521:0:15748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a458d3d800/0x2deb895b363e75c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838087.420530:0:15748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a458d3d800/0x2deb895b363e75c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838087.420542:0:15748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a458d3d800/0x2deb895b363e75c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838087.420578:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b09b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255049984:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788838087.420681:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838087.420742:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a3410839c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838087.420896:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255049984 00000100:00100000:3.0:1788838087.420906:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255049984 00000100:00100000:3.0:1788838087.420978:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788838087.420989:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44746fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+18:15748:x1875732255049984:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788838087.421007:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838087.421023:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a44a48b600/0x2deb895b363e75cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e75c4 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838087.421052:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a44a48b600/0x2deb895b363e75cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e75c4 expref: 19 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838087.421063:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a44a48b600/0x2deb895b363e75cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e75c4 expref: 19 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838087.421095:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48b600, rc 0) 00000100:00100000:3.0:1788838087.421150:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44746fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+19:15748:x1875732255049984:12345-0@lo:101:mount.lustre.0 Request processed in 162us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838087.421156:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788838087.421666:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b09b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255049984:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788838087.421685:0:15748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a458d3d800/0x2deb895b363e75c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e75cb expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838087.421695:0:15748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a458d3d800/0x2deb895b363e75c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e75cb expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788838087.422485:0:15748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1788838087.428149:0:15748:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788838087.428537:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788838087.428585:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788838087.428620:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788838087.428669:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788838087.428705:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788838087.428751:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788838087.428786:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788838087.428819:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788838087.428867:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788838087.428904:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788838087.428939:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788838087.429006:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788838087.429043:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788838087.429074:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788838087.429136:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788838087.429170:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788838087.429197:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788838087.429264:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788838087.429295:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788838087.429324:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788838087.429363:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788838087.429394:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788838087.429423:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788838087.429465:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788838087.429511:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788838087.429540:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788838087.429580:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788838087.429625:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788838087.429654:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788838087.433759:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1788838087.433881:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1788838087.433915:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1788838087.433944:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1788838087.434019:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1788838087.434060:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1788838087.434125:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1788838087.435819:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1788838087.436005:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1788838087.436015:0:15748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1788838087.436166:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b09b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255050112:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788838087.436284:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838087.436336:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a3410839c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838087.438069:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255050112 00000100:00100000:3.0:1788838087.438095:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255050112 00000100:00100000:3.0:1788838087.438171:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788838087.438183:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4551a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+19:15748:x1875732255050112:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838087.438600:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4551a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+19:15748:x1875732255050112:12345-0@lo:501:mount.lustre.0 Request processed in 417us (2314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838087.438609:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788838087.438682:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b09b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255050112:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788838087.438746:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b09b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255050240:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788838087.438802:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838087.438846:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a3410839c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838087.438931:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255050240 00000100:00100000:2.0:1788838087.438937:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255050240 00000100:00100000:2.0:1788838087.439482:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788838087.439495:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4551ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+19:15748:x1875732255050240:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788838087.439714:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4551ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+19:15748:x1875732255050240:12345-0@lo:503:mount.lustre.0 Request processed in 222us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838087.439722:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788838087.442631:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b09b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255050240:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788838087.443453:0:15748:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788838087.444099:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b09b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255050368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788838087.444248:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838087.444308:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a3410839c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838087.444311:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255050368 00000100:00100000:2.0:1788838087.444321:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255050368 00000100:00100000:2.0:1788838087.444384:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788838087.444395:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4551a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+19:15748:x1875732255050368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788838087.444705:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4551a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+19:15748:x1875732255050368:12345-0@lo:502:mount.lustre.0 Request processed in 311us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838087.444714:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788838087.444824:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b09b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255050368:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788838087.445150:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788838087.445243:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788838087.445279:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788838087.445338:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788838087.445378:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788838087.445434:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788838087.445474:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788838087.445510:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788838087.445574:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788838087.445610:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788838087.445642:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788838087.445691:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788838087.445727:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788838087.445762:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788838087.445810:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788838087.445860:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788838087.445892:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788838087.446384:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788838087.446445:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788838087.446478:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788838087.446530:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788838087.446567:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788838087.446601:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788838087.446645:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788838087.446698:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788838087.446730:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788838087.446774:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788838087.446809:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788838087.446841:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788838087.446891:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788838087.446927:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788838087.446962:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788838087.446996:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788838087.447043:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788838087.447079:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788838087.447145:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788838087.447176:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788838087.447284:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788838087.447332:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788838087.447363:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788838087.447423:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b852d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255050496:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788838087.447517:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838087.447570:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a45134fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788838087.448094:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255050496 00000100:00100000:1.0:1788838087.448106:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255050496 00000100:00100000:1.0:1788838087.448174:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788838087.448185:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44969f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+19:15748:x1875732255050496:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788838087.449673:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44969f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+19:15748:x1875732255050496:12345-0@lo:502:mount.lustre.0 Request processed in 1479us (2144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838087.449694:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788838087.451803:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b852d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255050496:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788838087.452034:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788838087.452054:0:15748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788838087.454440:0:15758:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788838087.454472:0:15758:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff97a34529cd28) 00000020:00000080:2.0:1788838087.454500:0:15758:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1788838087.454600:0:15758:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a4474f5800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788838087.454605:0:15758:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97a4474f5800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788838087.454608:0:15758:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a4474f5800 3 00010000:00080000:2.0:1788838087.454718:0:15758:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a44808b800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.154@tcp at head 00010000:00010000:2.0:1788838087.460604:0:15758:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1788838087.460854:0:15758:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788838087.460907:0:15758:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788838087.460923:0:15758:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2deb895b363e75d9 00000100:00080000:2.0:1788838087.460938:0:15758:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788838087.460945:0:15758:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97a44808b800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788838087.460992:0:15758:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a46ed78700 x1875732255050624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788838087.461133:0:3270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3270:1875732255050624:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788838087.461250:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788838087.461354:0:15758:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788838087.461421:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788838087.461427:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788838087.461429:0:36:0:(import.c:65:import_set_state_nolock()) ffff97a4712dc800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838087.461434:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 463 00000100:00080000:1.0:1788838087.461437:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788838087.461442:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97a4712dc800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788838087.461457:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a47b098e00 x1875732255050880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788838087.461517:0:3270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3270:1875732255050880:0@lo:8:kworker.0 00000100:00100000:0.0:1788838087.461550:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838087.461596:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255050624 00000100:00100000:3.0:1788838087.461597:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255050880 00000100:00100000:3.0:1788838087.461605:0:15027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255050880 00000100:00100000:0.0:1788838087.461605:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255050624 00000100:00100000:3.0:1788838087.461649:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788838087.461649:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788838087.461659:0:15027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3270:x1875732255050880:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788838087.461659:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3270:x1875732255050624:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788838087.461693:0:14342:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 467 last 0 00000020:00000080:0.0:1788838087.461746:0:14342:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2deb895b363e75e0 00000004:00100000:0.0:1788838087.461768:0:14342:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788838087.461808:0:14342:0:(import.c:65:import_set_state_nolock()) ffff97a47baf5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788838087.461879:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3270:x1875732255050624:12345-0@lo:38:llog_process_th.0 Request processed in 219us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838087.461904:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788838087.461961:0:3270:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a46ed78700 x1875732255050624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838087.461973:0:3270:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788838087.461983:0:3270:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788838087.461991:0:3270:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788838087.461996:0:3270:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788838087.461999:0:3270:0:(import.c:65:import_set_state_nolock()) ffff97a44808b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788838087.462006:0:3270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3270:1875732255050624:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788838087.462235:0:15758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:0.0:1788838087.462405:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b09b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255050752:0@lo:400:kworker.0 00000100:00100000:0.0:1788838087.462445:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838087.462685:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255050752 00000100:00100000:2.0:1788838087.462691:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255050752 00000100:00080000:0.0:1788838087.462724:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838087.462748:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788838087.462756:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255050752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838087.462811:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255050752:12345-0@lo:400:kworker.0 Request processed in 56us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838087.462818:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788838087.462821:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b09b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255050752:0@lo:400:kworker.0 00000020:01000000:2.0:1788838087.463268:0:15748:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788838087.463307:0:15748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788838087.463330:0:15748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a458d3d800/0x2deb895b363e75c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e75cb expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838087.463344:0:15748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a458d3d800/0x2deb895b363e75c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e75cb expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788838087.463404:0:15748:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788838087.463407:0:15748:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788838087.463408:0:15748:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838087.463410:0:15748:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838087.463411:0:15748:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838087.463413:0:15748:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838087.463414:0:15748:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788838087.463417:0:15748:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838087.463418:0:15748:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788838087.463423:0:15748:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788838087.463426:0:15748:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788838087.463428:0:15748:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788838087.463429:0:15748:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838087.463430:0:15748:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838087.463431:0:15748:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838087.463432:0:15748:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838087.463433:0:15748:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788838087.463434:0:15748:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838087.463435:0:15748:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788838087.463471:0:15748:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788838087.463488:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255051008:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788838087.463543:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838087.463578:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f9fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788838087.464236:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b09b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732255051136:0@lo:400:kworker.0 00000100:00100000:1.0:1788838087.464236:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b09b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3274:1875732255051264:0@lo:400:kworker.0 00000100:00100000:1.0:1788838087.464277:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838087.464331:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838087.464362:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255051264 00000100:00100000:1.0:1788838087.464370:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255051264 00000100:00100000:1.0:1788838087.464425:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255051136 00000100:00100000:1.0:1788838087.464428:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255051136 00000100:00100000:1.0:1788838087.464442:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788838087.464450:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b09b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1875732255051264:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788838087.464813:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788838087.464829:0:14342:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788838087.464831:0:14341:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788838087.464839:0:14341:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788838087.464843:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788838087.464852:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b09bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732255051136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838087.464898:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b09bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732255051136:12345-0@lo:400:kworker.0 Request processed in 47us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838087.464906:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788838087.465026:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a47b09b100 x1875732255051136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838087.465042:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b09b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732255051136:0@lo:400:kworker.0 00000100:00100000:1.0:1788838087.465659:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b09b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1875732255051264:12345-0@lo:400:kworker.0 Request processed in 1206us (1378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838087.465668:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788838087.465706:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a47b09b480 x1875732255051264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838087.465718:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b09b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3274:1875732255051264:0@lo:400:kworker.0 00000100:00100000:1.0:1788838087.465741:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255051008 00000100:00100000:1.0:1788838087.465753:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255051008 00000100:00100000:1.0:1788838087.466239:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788838087.466251:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44969d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+19:15748:x1875732255051008:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788838087.466286:0:14333:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788838087.466304:0:14333:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788838087.471966:0:15027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3270:x1875732255050880:12345-0@lo:8:kworker.0 Request processed in 10290us (10398us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788838087.471985:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788838087.472071:0:3270:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788838087.472094:0:3270:0:(import.c:65:import_set_state_nolock()) ffff97a4712dc800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838087.472100:0:3270:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788838087.472105:0:3270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3270:1875732255050880:0@lo:8:kworker.0 20000000:01000000:0.0:1788838087.526774:0:14333:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788838087.526799:0:14333:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788838087.526871:0:14356:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788838087.526877:0:14356:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788838087.526908:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a47bbb4400/0x2deb895b363e75e7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838087.526934:0:14356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a458d3d000/0x2deb895b363e74c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e74ba expref: 19 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838087.526946:0:14356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a47bbb4400/0x2deb895b363e75e7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838087.527001:0:14356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a458d3d000/0x2deb895b363e74c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e74ba expref: 19 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838087.527022:0:14356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a458d3d000/0x2deb895b363e74c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e74ba expref: 19 pid: 14334 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838087.527041:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed7b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14356:1875732255051392:0@lo:104: 00000100:00100000:2.0:1788838087.527153:0:14356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838087.527245:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a346b716c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838087.527428:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255051392 00000100:00100000:0.0:1788838087.527438:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255051392 00000100:00100000:0.0:1788838087.527634:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788838087.527647:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+3:14356:x1875732255051392:12345-0@lo:104: 00010000:00010000:0.0:1788838087.527663:0:14323:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a44a48ae00/0x2deb895b363e74ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e74c1 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838087.527747:0:14323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788838087.527754:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+3:14356:x1875732255051392:12345-0@lo:104: Request processed in 110us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838087.527783:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788838087.527882:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed7b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14356:1875732255051392:0@lo:104: 00010000:00010000:1.0:1788838087.527909:0:14356:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a47bbb4400/0x2deb895b363e75e7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838087.527977:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838087.527986:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a44a48ae00/0x2deb895b363e74ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e74c1 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838087.527995:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48ae00 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:3.0:1788838087.528000:0:14328:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a44a48ae00/0x2deb895b363e74ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e74c1 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838087.528009:0:14328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a44a48ae00/0x2deb895b363e74ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e74c1 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788838087.528018:0:14328:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a44a48ae00/0x2deb895b363e74ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e74c1 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838087.528025:0:14328:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788838087.528071:0:14328:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a44a48ae00/0x2deb895b363e74ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e74c1 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838087.528078:0:14328:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788838087.528133:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a44a48ae00/0x2deb895b363e74ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e74c1 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838087.528141:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a44a48ae00/0x2deb895b363e74ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e74c1 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838087.528162:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838087.528164:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838087.528166:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838087.528176:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788838087.528191:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3272:1875732255051520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788838087.528277:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838087.528333:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255051520 00000100:00100000:3.0:1788838087.528339:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255051520 00010000:00010000:3.0:1788838087.528362:0:14325:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a458d3d000/0x2deb895b363e74c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e74ba expref: 20 pid: 14334 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838087.528389:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788838087.528398:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b850000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+20:3272:x1875732255051520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788838087.528411:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838087.528417:0:14325:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a458d3d000/0x2deb895b363e74c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e74ba expref: 20 pid: 14334 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838087.528430:0:14325:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a458d3d000/0x2deb895b363e74c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e74ba expref: 20 pid: 14334 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838087.528446:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a458d3d000/0x2deb895b363e74c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e74ba expref: 20 pid: 14334 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838087.528462:0:14325:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a47bbb4400/0x2deb895b363e75e7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838087.528479:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a47bbb4400/0x2deb895b363e75e7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788838087.528668:0:14325:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005674819s 00010000:00010000:3.0:1788838087.528675:0:14325:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a47bbb4400/0x2deb895b363e75e7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838087.528685:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a47bbb4400/0x2deb895b363e75e7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838087.528692:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a47bbb4400/0x2deb895b363e75e7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838087.528700:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a47bbb4400/0x2deb895b363e75e7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838087.528706:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4400 already unused, calling callback (ffffffffc1616420) 00010000:00010000:3.0:1788838087.528710:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a47bbb4400/0x2deb895b363e75e7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838087.528719:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a47bbb4400/0x2deb895b363e75e7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838087.536043:0:14356:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97a47bbb4400/0x2deb895b363e75e7 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838087.536068:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a47bbb4400/0x2deb895b363e75e7 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838087.536257:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a47bbb4400/0x2deb895b363e75e7 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838087.536332:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a47bbb4400/0x2deb895b363e75e7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838087.536361:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788838087.537763:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b850000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+19:3272:x1875732255051520:12345-0@lo:103:ldlm_bl.0 Request processed in 9356us (9475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838087.537780:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788838087.542733:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3272:1875732255051520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838087.544705:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44969d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+18:15748:x1875732255051008:12345-0@lo:253:mount.lustre.0 Request processed in 78446us (81151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838087.544724:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788838087.544850:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfb679d1-2072-4f0b-b15a-39437d2c1c33:15748:1875732255051008:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788838087.544870:0:15748:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788838087.544874:0:15748:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788838087.544876:0:15748:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788838087.544878:0:15748:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838087.544879:0:15748:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838087.544881:0:15748:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838087.544882:0:15748:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838087.544884:0:15748:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788838087.544886:0:15748:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838087.544887:0:15748:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788838087.544906:0:15748:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788838087.548528:0:15748:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788838087.548717:0:15748:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788838087.548887:0:15748:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788838087.548984:0:15748:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788838087.549136:0:15748:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788838087.549352:0:15748:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788838087.550681:0:15748:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788838087.608175:0:15748:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788838087.608185:0:15748:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788838087.608533:0:15748:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788838087.608620:0:15748:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788838087.608639:0:15748:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788838087.608675:0:15748:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788838088.098685:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838088.354533:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b09b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255051648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788838088.354651:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838088.355172:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255051648 00000100:00100000:2.0:1788838088.355183:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255051648 00000100:00100000:2.0:1788838088.355343:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788838088.355355:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255051648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788838088.355406:0:15030:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788838088.355486:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255051648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838088.355495:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788838088.355624:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b09b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255051648:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1788838088.675679:0:14336:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788838088.675688:0:14336:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97a47b858800 from 8 10000000:01000000:0.0:1788838088.675693:0:14336:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788838088.675748:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a46e791800/0x2deb895b363e75ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838088.675761:0:14336:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a46e791800/0x2deb895b363e75ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838088.675774:0:14336:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a46e791800/0x2deb895b363e75ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838088.675802:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255051776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788838088.675878:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838088.675944:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b1abd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788838088.675947:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255051776 00000100:00100000:1.0:1788838088.675975:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255051776 00000100:00100000:1.0:1788838088.676075:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788838088.676089:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44969cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+18:14336:x1875732255051776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838088.676109:0:14332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838088.676132:0:14332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a458d3c600/0x2deb895b363e75f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e75ee expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838088.676169:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a458d3c600/0x2deb895b363e75f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e75ee expref: 19 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838088.676182:0:14332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a458d3c600/0x2deb895b363e75f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e75ee expref: 19 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838088.676192:0:14332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3c600, rc 0) 00000100:00100000:1.0:1788838088.676319:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44969cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+19:14336:x1875732255051776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 233us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838088.676328:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788838088.678951:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255051776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838088.679008:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a46e791800/0x2deb895b363e75ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e75f5 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838088.679022:0:14336:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a46e791800/0x2deb895b363e75ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e75f5 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838088.679609:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255051904:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788838088.679719:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838088.679768:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a47b1abd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788838088.679794:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255051904 00000100:00100000:0.0:1788838088.679801:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255051904 00000100:00100000:0.0:1788838088.679853:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788838088.679863:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44969f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+19:14336:x1875732255051904:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788838088.679888:0:14333:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788838088.679909:0:14333:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788838088.679913:0:14333:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788838088.680005:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44969f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+19:14336:x1875732255051904:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 143us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838088.680013:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788838088.680058:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255051904:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788838088.682107:0:14336:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788838088.682130:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a46e791800/0x2deb895b363e75ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e75f5 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838088.682146:0:14336:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a46e791800/0x2deb895b363e75ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e75f5 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838089.123741:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838090.148663:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838091.170372:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838092.194442:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788838092.963514:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788838092.963520:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788838092.963524:0:36:0:(import.c:65:import_set_state_nolock()) ffff97a4712dc800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838092.963535:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97a4712dc800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788838092.963572:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a47b099c00 x1875732255052288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838092.963640:0:3270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3270:1875732255052288:0@lo:8:kworker.0 00000100:00100000:1.0:1788838092.963643:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3273:1875732255052032:0@lo:400:kworker.0 00000100:00100000:1.0:1788838092.963719:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838092.963725:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838092.963779:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732255052672:0@lo:400:kworker.0 00000100:00100000:3.0:1788838092.963800:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b09a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732255052416:0@lo:400:kworker.0 00000100:00100000:1.0:1788838092.963813:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838092.963839:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788838092.963847:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255052160:0@lo:400:kworker.0 00000100:00100000:3.0:1788838092.963855:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838092.963884:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788838092.963891:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732255052544:0@lo:400:kworker.0 00000100:00100000:3.0:1788838092.966322:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838092.966383:0:15567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255052288 00000100:00100000:3.0:1788838092.966393:0:15567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255052288 00000100:00100000:3.0:1788838092.966437:0:15567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788838092.966446:0:15567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3270:x1875732255052288:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788838092.966482:0:15567:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:3.0:1788838092.966515:0:15567:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2deb895b363e75fc 00002000:00100000:3.0:1788838092.966532:0:15567:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff97a461925800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113975 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788838092.966537:0:15567:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788838092.966540:0:15567:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788838092.966708:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838092.966716:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255052672 00000100:00100000:3.0:1788838092.966722:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255052672 00000100:00100000:3.0:1788838092.966768:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255052416 00000100:00100000:3.0:1788838092.966772:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255052416 00000100:00100000:3.0:1788838092.966789:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255052544 00000100:00100000:3.0:1788838092.966792:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255052544 00000100:00100000:3.0:1788838092.966811:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788838092.966815:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255052032 00000100:00100000:3.0:1788838092.966820:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b09a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1875732255052672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838092.966823:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255052032 00000100:00100000:1.0:1788838092.966860:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788838092.966868:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44969ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+19:3273:x1875732255052032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838092.966905:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b09a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1875732255052672:12345-0@lo:400:kworker.0 Request processed in 86us (3090us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838092.966915:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788838092.966923:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44969ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+19:3273:x1875732255052032:12345-0@lo:400:kworker.0 Request processed in 55us (3202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838092.966932:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788838092.966938:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788838092.966947:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732255052416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838092.966973:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788838092.966995:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732255052544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838092.967002:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3271:x1875732255052416:12345-0@lo:400:kworker.0 Request processed in 55us (3149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838092.967009:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788838092.967036:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732255052544:12345-0@lo:400:kworker.0 Request processed in 43us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838092.967042:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788838092.967105:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3273:1875732255052032:0@lo:400:kworker.0 00010000:00080000:1.0:1788838092.967119:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a47b098700 x1875732255052672/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838092.967130:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732255052672:0@lo:400:kworker.0 00000100:00100000:2.0:1788838092.967351:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255052160 00000100:00100000:2.0:1788838092.967356:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255052160 00000100:00100000:2.0:1788838092.967385:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788838092.967393:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b09aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255052160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838092.967434:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b09aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255052160:12345-0@lo:400:kworker.0 Request processed in 42us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838092.967440:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788838092.967513:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255052160:0@lo:400:kworker.0 00000100:00080000:3.0:1788838092.972040:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788838092.972051:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:3.0:1788838092.972817:0:15567:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788838092.972853:0:15567:0:(import.c:65:import_set_state_nolock()) ffff97a461920000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788838092.972954:0:15567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3270:x1875732255052288:12345-0@lo:8:kworker.0 Request processed in 6507us (9231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838092.972964:0:15567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788838092.973031:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a47b099180 x1875732255052544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838092.973046:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732255052544:0@lo:400:kworker.0 00010000:00080000:3.0:1788838092.973060:0:3271:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a47b09a300 x1875732255052416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838092.973067:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b09a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3271:1875732255052416:0@lo:400:kworker.0 00010000:00080000:2.0:1788838092.973457:0:3270:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a47b099c00 x1875732255052288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788838117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788838092.973485:0:3270:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788838092.973494:0:3270:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788838092.973499:0:3270:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788838092.973502:0:3270:0:(import.c:65:import_set_state_nolock()) ffff97a4712dc800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788838092.973517:0:3270:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788838092.973522:0:3270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3270:1875732255052288:0@lo:8:kworker.0 00000004:00080000:3.0:1788838092.973597:0:14364:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788838092.973937:0:14365:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:1.0:1788838092.973961:0:14365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b098700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14365:1875732255052928:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788838092.973965:0:14364:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 473067761508ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788838092.974017:0:14365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838092.974045:0:14365:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a341083c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788838092.974180:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255052928 00000100:00100000:3.0:1788838092.974188:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255052928 00000100:00100000:3.0:1788838092.974261:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788838092.974277:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b099880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14365:x1875732255052928:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788838092.974671:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255052800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788838092.974703:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838092.974737:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255052800 00000100:00100000:1.0:1788838092.974741:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255052800 00000100:00100000:1.0:1788838092.974781:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788838092.974789:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b09ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3274:x1875732255052800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788838092.974825:0:15031:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788838092.974866:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b09ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3274:x1875732255052800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838092.974872:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788838092.974905:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a47b098a80 x1875732255052800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838108 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838092.974922:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255052800:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788838092.976726:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1788838092.984930:0:15029:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788838092.984940:0:15029:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1788838092.984945:0:15029:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:3.0:1788838092.999842:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788838092.999856:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb97bdf0/0x2deb895b363e7603 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838092.999874:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788838092.999879:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838092.999887:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb97bdf0/0x2deb895b363e7603 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838092.999907:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb97bdf0/0x2deb895b363e7603 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838092.999921:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb97bdf0/0x2deb895b363e7603 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838092.999931:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb97bdf0/0x2deb895b363e7603 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838092.999960:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838093.000072:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838093.000081:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb97bdf0/0x2deb895b363e7603 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.000092:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48ae00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:2.0:1788838093.000096:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb97bdf0/0x2deb895b363e7603 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.000106:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb97bdf0/0x2deb895b363e7603 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.000126:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb97bdf0/0x2deb895b363e7603 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.000135:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb97bdf0/0x2deb895b363e7603 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.000156:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838093.000158:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838093.000161:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838093.000492:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788838093.000498:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed55ce94/0x2deb895b363e760a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.000517:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788838093.000520:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838093.000525:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed55ce94/0x2deb895b363e760a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.000534:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed55ce94/0x2deb895b363e760a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.000542:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed55ce94/0x2deb895b363e760a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.000549:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed55ce94/0x2deb895b363e760a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.000564:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838093.000573:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838093.000577:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed55ce94/0x2deb895b363e760a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.000584:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48be00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:3.0:1788838093.000588:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed55ce94/0x2deb895b363e760a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.000596:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed55ce94/0x2deb895b363e760a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.000618:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed55ce94/0x2deb895b363e760a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.000625:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed55ce94/0x2deb895b363e760a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.000637:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838093.000639:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838093.000640:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838093.001036:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788838093.001043:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b439227f/0x2deb895b363e7611 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.001051:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788838093.001054:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838093.001058:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b439227f/0x2deb895b363e7611 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.001066:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b439227f/0x2deb895b363e7611 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.001074:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b439227f/0x2deb895b363e7611 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.001080:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b439227f/0x2deb895b363e7611 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.001113:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838093.001166:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838093.001173:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b439227f/0x2deb895b363e7611 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.001183:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48a200 already unused, calling callback (ffffffffc1616420) 00010000:00010000:2.0:1788838093.001187:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b439227f/0x2deb895b363e7611 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.001196:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b439227f/0x2deb895b363e7611 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.001295:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b439227f/0x2deb895b363e7611 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.001304:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b439227f/0x2deb895b363e7611 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.001317:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838093.001319:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838093.001321:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838093.002738:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788838093.002748:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad028b71/0x2deb895b363e7618 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.002762:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788838093.002765:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838093.002771:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad028b71/0x2deb895b363e7618 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.002784:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad028b71/0x2deb895b363e7618 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.002794:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad028b71/0x2deb895b363e7618 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.002801:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad028b71/0x2deb895b363e7618 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.002819:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838093.002832:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838093.002838:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad028b71/0x2deb895b363e7618 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.002845:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48b800 already unused, calling callback (ffffffffc1616420) 00010000:00010000:3.0:1788838093.002856:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad028b71/0x2deb895b363e7618 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.002864:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad028b71/0x2deb895b363e7618 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.002880:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad028b71/0x2deb895b363e7618 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.002887:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad028b71/0x2deb895b363e7618 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.002903:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838093.002905:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838093.002907:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838093.003506:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788838093.003514:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009590738f/0x2deb895b363e761f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.003523:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788838093.003527:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838093.003532:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009590738f/0x2deb895b363e761f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.003542:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009590738f/0x2deb895b363e761f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.003550:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009590738f/0x2deb895b363e761f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.003564:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009590738f/0x2deb895b363e761f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.003579:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838093.003590:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838093.003594:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009590738f/0x2deb895b363e761f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.003602:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48ba00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:3.0:1788838093.003606:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009590738f/0x2deb895b363e761f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.003614:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009590738f/0x2deb895b363e761f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.003628:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009590738f/0x2deb895b363e761f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.003635:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009590738f/0x2deb895b363e761f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.003652:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838093.003655:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838093.003658:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838093.004070:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788838093.004412:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9cb053b/0x2deb895b363e7626 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.004424:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788838093.004427:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838093.004433:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cb053b/0x2deb895b363e7626 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.004444:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9cb053b/0x2deb895b363e7626 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.004453:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9cb053b/0x2deb895b363e7626 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.004461:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cb053b/0x2deb895b363e7626 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.004476:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838093.004486:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838093.004491:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9cb053b/0x2deb895b363e7626 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.004497:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48b200 already unused, calling callback (ffffffffc1616420) 00010000:00010000:3.0:1788838093.004501:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9cb053b/0x2deb895b363e7626 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.004508:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9cb053b/0x2deb895b363e7626 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.004528:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9cb053b/0x2deb895b363e7626 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.004536:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9cb053b/0x2deb895b363e7626 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.004555:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838093.004558:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838093.004560:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838093.005035:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788838093.005042:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079823360/0x2deb895b363e762d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.005051:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788838093.005054:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838093.005058:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079823360/0x2deb895b363e762d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.005068:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079823360/0x2deb895b363e762d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.005076:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079823360/0x2deb895b363e762d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.005158:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079823360/0x2deb895b363e762d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.005186:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838093.005196:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838093.005218:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079823360/0x2deb895b363e762d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.005228:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48a800 already unused, calling callback (ffffffffc1616420) 00010000:00010000:3.0:1788838093.005232:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079823360/0x2deb895b363e762d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.005241:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079823360/0x2deb895b363e762d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.005254:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079823360/0x2deb895b363e762d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.005261:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079823360/0x2deb895b363e762d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.005277:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838093.005279:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838093.005281:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838093.006101:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788838093.006109:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb418b23/0x2deb895b363e7634 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.006120:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788838093.006130:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838093.006134:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb418b23/0x2deb895b363e7634 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.006146:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb418b23/0x2deb895b363e7634 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.006155:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb418b23/0x2deb895b363e7634 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.006162:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb418b23/0x2deb895b363e7634 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.006179:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838093.006190:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838093.006195:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb418b23/0x2deb895b363e7634 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.006238:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441465000 already unused, calling callback (ffffffffc1616420) 00010000:00010000:3.0:1788838093.006243:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb418b23/0x2deb895b363e7634 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.006251:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb418b23/0x2deb895b363e7634 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.006264:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb418b23/0x2deb895b363e7634 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.006283:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb418b23/0x2deb895b363e7634 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.006302:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838093.006304:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838093.006306:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838093.006870:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788838093.006876:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000a6b0be/0x2deb895b363e763b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.006885:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788838093.006889:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838093.006893:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000a6b0be/0x2deb895b363e763b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.006903:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000a6b0be/0x2deb895b363e763b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.006910:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000a6b0be/0x2deb895b363e763b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.006917:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000a6b0be/0x2deb895b363e763b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.006931:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788838093.007470:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788838093.007481:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080ec683a/0x2deb895b363e7642 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.007489:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788838093.007493:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838093.007497:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080ec683a/0x2deb895b363e7642 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.007507:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080ec683a/0x2deb895b363e7642 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.007515:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080ec683a/0x2deb895b363e7642 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.007522:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080ec683a/0x2deb895b363e7642 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.007535:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788838093.007544:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788838093.007556:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000a6b0be/0x2deb895b363e763b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.007563:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441465400 already unused, calling callback (ffffffffc1616420) 00010000:00010000:3.0:1788838093.007566:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000a6b0be/0x2deb895b363e763b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.007574:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000a6b0be/0x2deb895b363e763b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.007597:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000a6b0be/0x2deb895b363e763b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.007605:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000a6b0be/0x2deb895b363e763b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.007623:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838093.007627:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080ec683a/0x2deb895b363e7642 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.007634:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441464000 already unused, calling callback (ffffffffc1616420) 00010000:00010000:3.0:1788838093.007638:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080ec683a/0x2deb895b363e7642 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.007646:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080ec683a/0x2deb895b363e7642 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.007657:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080ec683a/0x2deb895b363e7642 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.007665:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080ec683a/0x2deb895b363e7642 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.007681:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838093.007683:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838093.007690:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838093.008109:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788838093.008115:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004aab0e42/0x2deb895b363e7649 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.008123:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788838093.008126:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838093.008130:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004aab0e42/0x2deb895b363e7649 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.008139:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004aab0e42/0x2deb895b363e7649 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.008147:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004aab0e42/0x2deb895b363e7649 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.008154:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004aab0e42/0x2deb895b363e7649 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.008168:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838093.008176:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838093.008180:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004aab0e42/0x2deb895b363e7649 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.008187:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441464c00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:3.0:1788838093.008191:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004aab0e42/0x2deb895b363e7649 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.008241:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004aab0e42/0x2deb895b363e7649 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.008253:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004aab0e42/0x2deb895b363e7649 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.008260:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004aab0e42/0x2deb895b363e7649 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.008275:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838093.008278:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838093.008281:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838093.010298:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838093.014654:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788838093.014668:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002e5e337/0x2deb895b363e7650 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788838093.014675:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1788838093.014692:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788838093.014699:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838093.014707:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002e5e337/0x2deb895b363e7650 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.014723:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002e5e337/0x2deb895b363e7650 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.014734:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002e5e337/0x2deb895b363e7650 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.014750:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002e5e337/0x2deb895b363e7650 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.015539:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838093.015585:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838093.015606:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002e5e337/0x2deb895b363e7650 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.015619:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441465600 already unused, calling callback (ffffffffc1616420) 00010000:00010000:2.0:1788838093.015624:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002e5e337/0x2deb895b363e7650 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.015855:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002e5e337/0x2deb895b363e7650 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.015878:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002e5e337/0x2deb895b363e7650 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.015886:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002e5e337/0x2deb895b363e7650 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.015909:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838093.015912:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838093.015914:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838093.016335:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788838093.020438:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004aab0e42/0x2deb895b363e7657 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.020460:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788838093.020464:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838093.020471:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004aab0e42/0x2deb895b363e7657 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.020486:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004aab0e42/0x2deb895b363e7657 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.020498:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004aab0e42/0x2deb895b363e7657 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.020505:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004aab0e42/0x2deb895b363e7657 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.020533:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788838093.021364:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788838093.021373:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080ec683a/0x2deb895b363e765e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.021390:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788838093.021394:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838093.021398:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080ec683a/0x2deb895b363e765e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.021409:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080ec683a/0x2deb895b363e765e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.021418:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080ec683a/0x2deb895b363e765e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.021426:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080ec683a/0x2deb895b363e765e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.021447:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788838093.021462:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788838093.021469:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004aab0e42/0x2deb895b363e7657 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.021477:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441464c00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:3.0:1788838093.021482:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004aab0e42/0x2deb895b363e7657 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838093.021486:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838093.021493:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004aab0e42/0x2deb895b363e7657 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.021522:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004aab0e42/0x2deb895b363e7657 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.021530:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004aab0e42/0x2deb895b363e7657 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.021549:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838093.021551:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838093.021553:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838093.022272:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788838093.022279:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000a6b0be/0x2deb895b363e7665 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.022289:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788838093.022292:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838093.022296:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000a6b0be/0x2deb895b363e7665 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.022304:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000a6b0be/0x2deb895b363e7665 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.022311:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000a6b0be/0x2deb895b363e7665 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.022319:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000a6b0be/0x2deb895b363e7665 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.022356:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838093.022368:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838093.022371:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000a6b0be/0x2deb895b363e7665 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.022378:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441465400 already unused, calling callback (ffffffffc1616420) 00010000:00010000:3.0:1788838093.022381:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000a6b0be/0x2deb895b363e7665 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.022389:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000a6b0be/0x2deb895b363e7665 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.022401:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000a6b0be/0x2deb895b363e7665 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.022409:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000a6b0be/0x2deb895b363e7665 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.022422:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838093.022425:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838093.022426:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838093.022866:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788838093.022873:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb418b23/0x2deb895b363e766c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.022882:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788838093.022891:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838093.022895:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb418b23/0x2deb895b363e766c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.022904:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb418b23/0x2deb895b363e766c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.022912:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb418b23/0x2deb895b363e766c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.022919:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb418b23/0x2deb895b363e766c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.022993:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838093.023156:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838093.023163:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb418b23/0x2deb895b363e766c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.023171:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441465000 already unused, calling callback (ffffffffc1616420) 00010000:00010000:2.0:1788838093.023174:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb418b23/0x2deb895b363e766c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.023181:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb418b23/0x2deb895b363e766c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.023193:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb418b23/0x2deb895b363e766c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.023237:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb418b23/0x2deb895b363e766c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.023256:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838093.023258:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838093.023260:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838093.023644:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788838093.023650:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035821bf2/0x2deb895b363e7673 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.023659:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788838093.023663:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838093.023668:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035821bf2/0x2deb895b363e7673 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.023678:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035821bf2/0x2deb895b363e7673 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.023686:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035821bf2/0x2deb895b363e7673 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.023701:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035821bf2/0x2deb895b363e7673 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.023758:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788838093.024179:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788838093.024184:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006343c95f/0x2deb895b363e767a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.024193:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788838093.024196:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838093.024220:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006343c95f/0x2deb895b363e767a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.024232:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006343c95f/0x2deb895b363e767a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.024241:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006343c95f/0x2deb895b363e767a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.024248:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006343c95f/0x2deb895b363e767a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.024372:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788838093.024378:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035821bf2/0x2deb895b363e7673 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.024385:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441464a00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:2.0:1788838093.024389:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035821bf2/0x2deb895b363e7673 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.024397:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035821bf2/0x2deb895b363e7673 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.024411:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035821bf2/0x2deb895b363e7673 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.024418:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035821bf2/0x2deb895b363e7673 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.024433:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838093.024436:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006343c95f/0x2deb895b363e767a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.024447:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788838093.024449:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441465800 already unused, calling callback (ffffffffc1616420) 00010000:00010000:2.0:1788838093.024453:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006343c95f/0x2deb895b363e767a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.024460:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006343c95f/0x2deb895b363e767a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.024471:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006343c95f/0x2deb895b363e767a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.024478:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006343c95f/0x2deb895b363e767a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.024491:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838093.024492:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838093.024494:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838093.024933:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788838093.024939:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dce3a612/0x2deb895b363e7681 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.024953:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788838093.024956:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838093.024961:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dce3a612/0x2deb895b363e7681 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.024970:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dce3a612/0x2deb895b363e7681 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.024991:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dce3a612/0x2deb895b363e7681 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.024999:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dce3a612/0x2deb895b363e7681 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.025019:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838093.025167:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838093.025173:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dce3a612/0x2deb895b363e7681 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.025180:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441464400 already unused, calling callback (ffffffffc1616420) 00010000:00010000:2.0:1788838093.025183:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dce3a612/0x2deb895b363e7681 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.025192:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dce3a612/0x2deb895b363e7681 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.025235:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dce3a612/0x2deb895b363e7681 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.025243:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dce3a612/0x2deb895b363e7681 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.025256:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838093.025258:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838093.025260:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838093.025640:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788838093.025646:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1920b17/0x2deb895b363e7688 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.025654:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788838093.025656:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838093.025661:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1920b17/0x2deb895b363e7688 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.025669:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1920b17/0x2deb895b363e7688 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.025687:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1920b17/0x2deb895b363e7688 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.025693:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1920b17/0x2deb895b363e7688 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.025748:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788838093.026189:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788838093.026196:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007de9f3b8/0x2deb895b363e768f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.026229:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788838093.026232:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838093.026236:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007de9f3b8/0x2deb895b363e768f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.026246:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007de9f3b8/0x2deb895b363e768f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.026254:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007de9f3b8/0x2deb895b363e768f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.026263:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007de9f3b8/0x2deb895b363e768f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.026360:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788838093.026366:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1920b17/0x2deb895b363e7688 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.026374:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441465a00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:2.0:1788838093.026377:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1920b17/0x2deb895b363e7688 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.026385:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1920b17/0x2deb895b363e7688 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.026397:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1920b17/0x2deb895b363e7688 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.026404:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1920b17/0x2deb895b363e7688 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.026432:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838093.026436:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007de9f3b8/0x2deb895b363e768f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.026442:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441464e00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:2.0:1788838093.026445:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007de9f3b8/0x2deb895b363e768f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.026452:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007de9f3b8/0x2deb895b363e768f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.026464:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007de9f3b8/0x2deb895b363e768f lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.026472:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838093.026473:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838093.026474:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838093.026883:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788838093.026888:0:15029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007de9f3b8/0x2deb895b363e768f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.026965:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838093.027926:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788838093.027934:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa142e90/0x2deb895b363e7696 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.027946:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788838093.027950:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838093.027960:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa142e90/0x2deb895b363e7696 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.027973:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa142e90/0x2deb895b363e7696 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.028055:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa142e90/0x2deb895b363e7696 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.028064:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa142e90/0x2deb895b363e7696 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.028081:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838093.028092:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838093.028097:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa142e90/0x2deb895b363e7696 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.028111:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441464600 already unused, calling callback (ffffffffc1616420) 00010000:00010000:3.0:1788838093.028115:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa142e90/0x2deb895b363e7696 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.028124:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa142e90/0x2deb895b363e7696 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.028138:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa142e90/0x2deb895b363e7696 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.028464:0:16053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838093.028466:0:16053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838093.028468:0:16053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838093.028505:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080ec683a/0x2deb895b363e765e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838093.028514:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441464000 already unused, calling callback (ffffffffc1616420) 00010000:00010000:1.0:1788838093.028518:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080ec683a/0x2deb895b363e765e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838093.028526:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080ec683a/0x2deb895b363e765e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838093.028540:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080ec683a/0x2deb895b363e765e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838093.028547:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080ec683a/0x2deb895b363e765e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838093.028568:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838093.028570:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838093.028577:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838093.028604:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa142e90/0x2deb895b363e7696 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.028619:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838093.028621:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838093.028623:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838093.029132:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788838093.029150:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e5ad692/0x2deb895b363e769d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.029160:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788838093.029164:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838093.029167:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e5ad692/0x2deb895b363e769d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.029181:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e5ad692/0x2deb895b363e769d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.029192:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e5ad692/0x2deb895b363e769d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.029196:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e5ad692/0x2deb895b363e769d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.029289:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838093.029646:0:16053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838093.029653:0:16053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e5ad692/0x2deb895b363e769d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.029662:0:16053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441465e00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:2.0:1788838093.029672:0:16053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e5ad692/0x2deb895b363e769d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.029680:0:16053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e5ad692/0x2deb895b363e769d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.029692:0:16053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e5ad692/0x2deb895b363e769d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.029699:0:16053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e5ad692/0x2deb895b363e769d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.029714:0:16053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838093.029717:0:16053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838093.029719:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788838093.029719:0:16053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838093.029725:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004aab0e42/0x2deb895b363e76a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.029733:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788838093.029736:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838093.029740:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004aab0e42/0x2deb895b363e76a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.029749:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004aab0e42/0x2deb895b363e76a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.029757:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004aab0e42/0x2deb895b363e76a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.029763:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004aab0e42/0x2deb895b363e76a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.029792:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838093.030071:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838093.030077:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004aab0e42/0x2deb895b363e76a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.030085:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441464c00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:2.0:1788838093.030088:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004aab0e42/0x2deb895b363e76a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.030096:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004aab0e42/0x2deb895b363e76a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.030108:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004aab0e42/0x2deb895b363e76a4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.030122:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004aab0e42/0x2deb895b363e76a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.030136:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838093.030138:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838093.030140:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838093.030225:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788838093.030231:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002e5e337/0x2deb895b363e76ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.030240:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788838093.030244:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838093.030249:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002e5e337/0x2deb895b363e76ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.030258:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002e5e337/0x2deb895b363e76ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.030266:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002e5e337/0x2deb895b363e76ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.030274:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002e5e337/0x2deb895b363e76ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.030293:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838093.030402:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838093.030407:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002e5e337/0x2deb895b363e76ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.030415:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441465600 already unused, calling callback (ffffffffc1616420) 00010000:00010000:2.0:1788838093.030418:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002e5e337/0x2deb895b363e76ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.030426:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002e5e337/0x2deb895b363e76ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.030437:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002e5e337/0x2deb895b363e76ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.030445:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002e5e337/0x2deb895b363e76ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.030457:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838093.030459:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838093.030461:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838093.031009:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788838093.031017:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079823360/0x2deb895b363e76b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.031026:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788838093.031035:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838093.031040:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079823360/0x2deb895b363e76b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.031049:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079823360/0x2deb895b363e76b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.031058:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079823360/0x2deb895b363e76b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.031066:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079823360/0x2deb895b363e76b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.031089:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838093.031272:0:16053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838093.031335:0:16053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079823360/0x2deb895b363e76b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.031344:0:16053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48a800 already unused, calling callback (ffffffffc1616420) 00010000:00010000:2.0:1788838093.031348:0:16053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079823360/0x2deb895b363e76b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.031356:0:16053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079823360/0x2deb895b363e76b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.031370:0:16053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079823360/0x2deb895b363e76b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.031376:0:16053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079823360/0x2deb895b363e76b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.031390:0:16053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838093.031392:0:16053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838093.031393:0:16053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838093.033116:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788838093.033127:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9cb053b/0x2deb895b363e76b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.033140:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788838093.033144:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838093.033149:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cb053b/0x2deb895b363e76b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.033161:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9cb053b/0x2deb895b363e76b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.033171:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9cb053b/0x2deb895b363e76b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.033186:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cb053b/0x2deb895b363e76b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.033228:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838093.033582:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838093.033589:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9cb053b/0x2deb895b363e76b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.033597:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48b200 already unused, calling callback (ffffffffc1616420) 00010000:00010000:2.0:1788838093.033601:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9cb053b/0x2deb895b363e76b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.033620:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9cb053b/0x2deb895b363e76b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.033636:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9cb053b/0x2deb895b363e76b9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.033644:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9cb053b/0x2deb895b363e76b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838093.033647:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788838093.033652:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009590738f/0x2deb895b363e76c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.033660:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788838093.033662:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838093.033664:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838093.033664:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838093.033667:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838093.033668:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009590738f/0x2deb895b363e76c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.033677:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009590738f/0x2deb895b363e76c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.033685:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009590738f/0x2deb895b363e76c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.033692:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009590738f/0x2deb895b363e76c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838093.033714:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838093.033775:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838093.033781:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009590738f/0x2deb895b363e76c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.033788:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48ba00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:2.0:1788838093.033792:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009590738f/0x2deb895b363e76c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.033799:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009590738f/0x2deb895b363e76c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.033811:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009590738f/0x2deb895b363e76c0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.033830:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009590738f/0x2deb895b363e76c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838093.033843:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838093.033845:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838093.033847:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788838093.033878:0:15029:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:3.0:1788838093.033993:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b099880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14365:x1875732255052928:12345-0@lo:5:osp-pre-1-0.0 Request processed in 59714us (59972us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838093.034010:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788838093.034076:0:14365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b098700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14365:1875732255052928:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788838093.034092:0:14365:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788838093.034138:0:14365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed78700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14365:1875732255053056:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788838093.034189:0:14365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838093.034253:0:14365:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a3458950c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838093.034492:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255053056 00000100:00100000:3.0:1788838093.034499:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255053056 00000100:00100000:3.0:1788838093.034540:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788838093.034549:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14365:x1875732255053056:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788838093.034588:0:15028:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1788838093.043385:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14365:x1875732255053056:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8829us (9188us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788838093.043398:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788838093.043484:0:14365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed78700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14365:1875732255053056:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788838093.043500:0:14365:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1788838093.218327:0:16053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838093.478656:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788838093.478681:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255053184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788838093.478750:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838093.478808:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255053184 00000100:00100000:1.0:1788838093.478814:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255053184 00000100:00100000:1.0:1788838093.478857:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788838093.478867:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255053184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788838093.478902:0:15031:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788838093.478943:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255053184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838093.478950:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788838093.479007:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255053184:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788838093.745312:0:16107:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788838094.242999:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788838094.895400:0:14371:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788838095.276154:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838096.093047:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788838096.093255:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240377216 00000100:00100000:0.0:1788838096.093339:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240377216 00000100:00100000:0.0:1788838096.093391:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 76 00000100:00100000:0.0:1788838096.093401:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44969d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2348:x1875732240377216:12345-192.168.204.54@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788838096.093430:0:14334:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from d2da147b-5a5a-4591-ba5b-bd1ff99f5864@192.168.204.54@tcp t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:0.0:1788838096.093460:0:14334:0:(genops.c:1385:class_connect()) connect: client d2da147b-5a5a-4591-ba5b-bd1ff99f5864, cookie 0x2deb895b363e76c7 00000100:00080000:0.0:1788838096.093596:0:14334:0:(import.c:65:import_set_state_nolock()) ffff97a47baf2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788838096.094008:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44969d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+5:2348:x1875732240377216:12345-192.168.204.54@tcp:250:mount.lustre.0 Request processed in 605us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838096.094017:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 76 00000100:00100000:3.0:1788838096.111877:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788838096.112249:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240377344 00000100:00100000:1.0:1788838096.112265:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240377344 00000100:00100000:1.0:1788838096.112348:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:1.0:1788838096.112359:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44969c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+5:13767:x1875732240377344:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788838096.112376:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838096.112397:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a458d3c400/0x2deb895b363e76ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d38f expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838096.112428:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a458d3c400/0x2deb895b363e76ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d38f expref: 6 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838096.112440:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a458d3c400/0x2deb895b363e76ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d38f expref: 6 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838096.112464:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3c400, rc 0) 00000100:00100000:1.0:1788838096.112534:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44969c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+6:13767:x1875732240377344:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 177us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838096.112542:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:2.0:1788838096.122050:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788838096.122418:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240377472 00000100:00100000:0.0:1788838096.122432:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240377472 00000100:00100000:0.0:1788838096.122506:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:0.0:1788838096.122518:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a345183c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+6:13767:x1875732240377472:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788838096.126381:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a345183c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+6:13767:x1875732240377472:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 3848us (4331us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788838096.126399:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:3.0:1788838096.133749:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838096.133873:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240377600 00000100:00100000:2.0:1788838096.133888:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240377600 00000100:00100000:2.0:1788838096.133977:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 79 00000100:00100000:2.0:1788838096.133988:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a345183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+6:13767:x1875732240377600:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788838096.134014:0:14332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838096.134039:0:14332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a47bbb4c00/0x2deb895b363e76d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d396 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838096.134080:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a47bbb4c00/0x2deb895b363e76d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d396 expref: 7 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838096.134125:0:14332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a47bbb4c00/0x2deb895b363e76d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d396 expref: 7 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838096.134138:0:14332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4c00, rc 0) 00000100:00100000:2.0:1788838096.134363:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a345183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+7:13767:x1875732240377600:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 375us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838096.134370:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 79 00000100:00100000:3.0:1788838096.141405:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788838096.141939:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240377728 00000100:00100000:0.0:1788838096.141954:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240377728 00000100:00100000:0.0:1788838096.142033:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:0.0:1788838096.142045:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a345182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+7:13767:x1875732240377728:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788838096.142647:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a345182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+8:13767:x1875732240377728:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 600us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838096.142658:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:0.0:1788838096.145380:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788838096.145496:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240377856 00000100:00100000:1.0:1788838096.145509:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240377856 00000100:00100000:1.0:1788838096.145576:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00100000:1.0:1788838096.145589:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a345182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+8:13767:x1875732240377856:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788838096.146281:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a345182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+8:13767:x1875732240377856:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 691us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838096.146293:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00100000:3.0:1788838096.150948:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838096.151095:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240377984 00000100:00100000:2.0:1788838096.151109:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240377984 00000100:00100000:2.0:1788838096.151188:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 82 00000100:00100000:2.0:1788838096.151321:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a345181050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+8:13786:x1875732240377984:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788838096.152133:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a345181050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+8:13786:x1875732240377984:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 812us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838096.152144:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 82 00000100:00100000:2.0:1788838096.168493:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788838096.168734:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240378112 00000100:00100000:1.0:1788838096.168749:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240378112 00000100:00100000:1.0:1788838096.168826:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 83 00000100:00100000:1.0:1788838096.168839:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a345180450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+8:13786:x1875732240378112:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788838096.169342:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a345180450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+8:13786:x1875732240378112:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 503us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838096.169352:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 83 00000100:00100000:0.0:1788838096.188073:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838096.188348:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240378240 00000100:00100000:2.0:1788838096.188362:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240378240 00000100:00100000:2.0:1788838096.188743:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 84 00000100:00100000:2.0:1788838096.188759:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a345180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+8:13767:x1875732240378240:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788838096.188889:0:14332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838096.188924:0:14332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a47bbb4600/0x2deb895b363e76dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d3c0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838096.188964:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a47bbb4600/0x2deb895b363e76dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d3c0 expref: 9 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838096.188993:0:14332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a47bbb4600/0x2deb895b363e76dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d3c0 expref: 9 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838096.189005:0:14332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4600, rc 0) 00000100:00100000:2.0:1788838096.189097:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a345180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+9:13767:x1875732240378240:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 343us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838096.189104:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 84 00000100:00100000:2.0:1788838096.195868:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788838096.204776:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240378368 00000100:00100000:0.0:1788838096.204802:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240378368 00000100:00100000:0.0:1788838096.204987:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 85 00000100:00100000:0.0:1788838096.205000:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a345183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+9:13767:x1875732240378368:12345-192.168.204.54@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788838096.205036:0:14334:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788838096.205071:0:14334:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788838096.205075:0:14334:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788838096.205078:0:14334:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788838096.205080:0:14334:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1788838096.209367:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a345183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+9:13767:x1875732240378368:12345-192.168.204.54@tcp:256:mount.lustre.0 Request processed in 4352us (13496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838096.209385:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 85 00000100:00100000:3.0:1788838096.212579:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788838096.213753:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240378496 00000100:00100000:1.0:1788838096.213782:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240378496 00000100:00100000:1.0:1788838096.213869:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:1.0:1788838096.213881:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47c8f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+9:13767:x1875732240378496:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788838096.213906:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838096.213945:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a458d3c800/0x2deb895b363e76e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d3c7 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838096.214004:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a458d3c800/0x2deb895b363e76e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d3c7 expref: 10 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838096.214018:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a458d3c800/0x2deb895b363e76e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d3c7 expref: 10 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838096.214030:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3c800, rc 0) 00000100:00100000:1.0:1788838096.214278:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47c8f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+10:13767:x1875732240378496:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 398us (1721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838096.214287:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:2.0:1788838096.221339:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838096.221502:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240378624 00000100:00100000:3.0:1788838096.221516:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240378624 00000100:00100000:3.0:1788838096.221600:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:3.0:1788838096.221612:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47c8f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+10:13767:x1875732240378624:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788838096.222865:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47c8f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+10:13767:x1875732240378624:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 1247us (1533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838096.222878:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:1.0:1788838096.225052:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838096.225172:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240378752 00000100:00100000:2.0:1788838096.225185:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240378752 00000100:00100000:2.0:1788838096.225414:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 88 00000100:00100000:2.0:1788838096.225427:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47c8f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+10:13767:x1875732240378752:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788838096.226096:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47c8f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+10:13767:x1875732240378752:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 669us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838096.226106:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 88 00000100:00100000:0.0:1788838096.232348:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838096.232532:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240378880 00000100:00100000:3.0:1788838096.232575:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240378880 00000100:00100000:3.0:1788838096.232647:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 89 00000100:00100000:3.0:1788838096.232659:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47c8f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+10:13791:x1875732240378880:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788838096.233054:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47c8f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+10:13791:x1875732240378880:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 396us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838096.233063:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 89 00000100:00100000:2.0:1788838096.237032:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788838096.237288:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240379008 00000100:00100000:1.0:1788838096.237301:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240379008 00000100:00100000:1.0:1788838096.237419:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 90 00000100:00100000:1.0:1788838096.237432:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47c8f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+10:13791:x1875732240379008:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788838096.237781:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47c8f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+10:13791:x1875732240379008:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 350us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838096.237790:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 90 00000100:00100000:1.0:1788838096.250461:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838096.250554:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240379136 00000100:00100000:3.0:1788838096.250567:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240379136 00000100:00100000:3.0:1788838096.250640:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:3.0:1788838096.250714:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2348:x1875732240379136:12345-192.168.204.54@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788838096.250758:0:14340:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 08402154-aa3b-4815-843a-48a3cef38095@192.168.204.54@tcp t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:3.0:1788838096.250825:0:14340:0:(genops.c:1385:class_connect()) connect: client 08402154-aa3b-4815-843a-48a3cef38095, cookie 0x2deb895b363e76ea 00000004:00100000:3.0:1788838096.250868:0:14340:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788838096.250876:0:14340:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:2.0:1788838096.290610:0:16053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788838096.297287:0:14340:0:(import.c:65:import_set_state_nolock()) ffff97a44a000800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788838096.297800:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08402154-aa3b-4815-843a-48a3cef38095+6:2348:x1875732240379136:12345-192.168.204.54@tcp:38:mount.lustre.0 Request processed in 47145us (47350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838096.297813:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:0.0:1788838096.301801:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788838096.301858:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838096.301952:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240379264 00000100:00100000:1.0:1788838096.301973:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240379392 00000100:00100000:3.0:1788838096.301976:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240379264 00000100:00100000:1.0:1788838096.301984:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240379392 00000100:00080000:0.0:1788838096.302098:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788838096.302162:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:1.0:1788838096.302178:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08402154-aa3b-4815-843a-48a3cef38095+7:13767:x1875732240379392:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788838096.302298:0:14342:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788838096.302409:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08402154-aa3b-4815-843a-48a3cef38095+7:13767:x1875732240379392:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 235us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838096.302436:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:1.0:1788838096.302457:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:1.0:1788838096.302465:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08402154-aa3b-4815-843a-48a3cef38095+6:0:x1875732240379264:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788838096.302478:0:14342:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788838096.302503:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08402154-aa3b-4815-843a-48a3cef38095+6:0:x1875732240379264:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 39us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838096.302509:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:2.0:1788838096.307688:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788838096.308022:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240379520 00000100:00100000:1.0:1788838096.308036:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240379520 00000100:00100000:1.0:1788838096.308104:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:1.0:1788838096.308115:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08402154-aa3b-4815-843a-48a3cef38095+6:13767:x1875732240379520:12345-192.168.204.54@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788838096.308271:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08402154-aa3b-4815-843a-48a3cef38095+6:13767:x1875732240379520:12345-192.168.204.54@tcp:40:mount.lustre.0 Request processed in 157us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838096.308279:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:0.0:1788838096.312046:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788838096.312118:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838096.312262:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240379648 00000100:00100000:3.0:1788838096.312277:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240379648 00000100:00100000:3.0:1788838096.312341:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240379776 00000100:00100000:3.0:1788838096.312344:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240379776 00000100:00100000:3.0:1788838096.312385:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:3.0:1788838096.312395:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1875732240379648:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788838096.312436:0:15029:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 08402154-aa3b-4815-843a-48a3cef38095@192.168.204.54@tcp t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:3.0:1788838096.312490:0:15029:0:(genops.c:1385:class_connect()) connect: client 08402154-aa3b-4815-843a-48a3cef38095, cookie 0x2deb895b363e76f1 00002000:00100000:3.0:1788838096.312505:0:15029:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 08402154-aa3b-4815-843a-48a3cef38095/ffff97a44a005000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113975 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788838096.312547:0:15029:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788838096.313262:0:15567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:2.0:1788838096.313272:0:15567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1875732240379776:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788838096.313299:0:15567:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 08402154-aa3b-4815-843a-48a3cef38095@192.168.204.54@tcp t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:2.0:1788838096.313323:0:15567:0:(genops.c:1385:class_connect()) connect: client 08402154-aa3b-4815-843a-48a3cef38095, cookie 0x2deb895b363e76f8 00002000:00100000:2.0:1788838096.313332:0:15567:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 08402154-aa3b-4815-843a-48a3cef38095/ffff97a448f74800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113975 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788838096.313373:0:15567:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788838096.313698:0:15567:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788838096.313741:0:15567:0:(import.c:65:import_set_state_nolock()) ffff97a448f77800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788838096.313834:0:15567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08402154-aa3b-4815-843a-48a3cef38095+6:2348:x1875732240379776:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 561us (1714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838096.313843:0:15567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00002000:00080000:3.0:1788838096.318485:0:15029:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1788838096.318721:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00080000:3.0:1788838096.318828:0:15029:0:(import.c:65:import_set_state_nolock()) ffff97a344b35800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788838096.318946:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:08402154-aa3b-4815-843a-48a3cef38095+6:2348:x1875732240379648:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 6549us (6912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838096.318965:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:2.0:1788838096.321252:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240379904 00000100:00100000:2.0:1788838096.321276:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240379904 00000100:00100000:2.0:1788838096.321549:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:2.0:1788838096.321562:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08402154-aa3b-4815-843a-48a3cef38095+6:13767:x1875732240379904:12345-192.168.204.54@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788838096.322714:0:14343:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1041us 00000004:00200000:0.0:1788838096.340637:0:14343:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788838096.340847:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08402154-aa3b-4815-843a-48a3cef38095+6:13767:x1875732240379904:12345-192.168.204.54@tcp:33:mount.lustre.0 Request processed in 19278us (22118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838096.340866:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:0.0:1788838096.506583:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838096.506685:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240380032 00000100:00100000:3.0:1788838096.506701:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240380032 00000100:00100000:3.0:1788838096.506814:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:3.0:1788838096.506825:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08402154-aa3b-4815-843a-48a3cef38095+6:13812:x1875732240380032:12345-192.168.204.54@tcp:101:mkdir.0 00010000:00010000:3.0:1788838096.506853:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838096.506888:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b800/0x2deb895b363e76ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d3f1 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838096.507002:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e7706 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838096.507020:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e7706 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838096.507038:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e7706 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838096.507084:0:14340:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788838096.507088:0:14340:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788838096.507135:0:14340:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e7706 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838096.507187:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b800/0x2deb895b363e76ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d3f1 expref: 8 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838096.507262:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e7706 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d3f1 expref: 7 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838096.507273:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a461771f00) 00010000:00010000:3.0:1788838096.507276:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788838096.507280:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48a200, rc 0) 00000100:00100000:3.0:1788838096.507354:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08402154-aa3b-4815-843a-48a3cef38095+7:13812:x1875732240380032:12345-192.168.204.54@tcp:101:mkdir.0 Request processed in 530us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838096.507362:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00010000:00010000:1.0:1788838097.314605:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838098.083906:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788838098.083939:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255053312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788838098.084054:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838098.084088:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255053312 00000100:00100000:1.0:1788838098.084100:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255053312 00000100:00100000:1.0:1788838098.084181:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788838098.084192:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3271:x1875732255053312:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788838098.084411:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788838098.084736:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255053568:0@lo:400:kworker.0 00000100:00100000:3.0:1788838098.084783:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838098.084826:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3273:1875732255053440:0@lo:400:kworker.0 00000100:00100000:3.0:1788838098.084837:0:15567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255053568 00000100:00100000:3.0:1788838098.084844:0:15567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255053568 00000100:00100000:2.0:1788838098.084896:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838098.084907:0:15567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788838098.084917:0:15567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732255053568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838098.084934:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732255053952:0@lo:400:kworker.0 00002000:00000024:1.0:1788838098.085034:0:15031:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788838098.086575:0:15567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732255053568:12345-0@lo:400:kworker.0 Request processed in 1646us (1776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838098.086592:0:15567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788838098.087420:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838098.087472:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3271:x1875732255053312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3278us (3418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838098.087485:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788838098.087498:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255053440 00000100:00100000:2.0:1788838098.087511:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255053440 00000100:00100000:1.0:1788838098.087527:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255053952 00000100:00100000:1.0:1788838098.087533:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255053952 00000100:00100000:2.0:1788838098.087569:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788838098.087581:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47c8f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+19:3273:x1875732255053440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838098.087597:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788838098.087608:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1875732255053952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838098.087648:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47c8f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+19:3273:x1875732255053440:12345-0@lo:400:kworker.0 Request processed in 69us (2753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838098.087656:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788838098.087723:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1875732255053952:12345-0@lo:400:kworker.0 Request processed in 118us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838098.087731:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788838098.087802:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3272:1875732255053824:0@lo:400:kworker.0 00000100:00100000:1.0:1788838098.087839:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838098.087870:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788838098.087984:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3272:1875732255053696:0@lo:400:kworker.0 00000100:00100000:1.0:1788838098.088013:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838098.088043:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255053824 00000100:00100000:1.0:1788838098.088048:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255053824 00000100:00100000:1.0:1788838098.088129:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255053696 00000100:00100000:1.0:1788838098.088133:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255053696 00000100:00100000:1.0:1788838098.088156:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788838098.088164:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1875732255053824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838098.088576:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1875732255053824:12345-0@lo:400:kworker.0 Request processed in 411us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838098.088585:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788838098.088605:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788838098.088614:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1875732255053696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838098.089129:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1875732255053696:12345-0@lo:400:kworker.0 Request processed in 450us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838098.089139:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788838098.089172:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788838098.089179:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788838098.089455:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3272:1875732255053696:0@lo:400:kworker.0 00000100:00100000:1.0:1788838098.089487:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3272:1875732255053824:0@lo:400:kworker.0 00000100:00100000:2.0:1788838098.089530:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3273:1875732255053952:0@lo:400:kworker.0 00000100:00100000:1.0:1788838098.089557:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255053312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788838098.089564:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3273:1875732255053440:0@lo:400:kworker.0 00000100:00100000:2.0:1788838098.089628:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255053568:0@lo:400:kworker.0 00000001:00100000:2.0:1788838098.195979:0:7611:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 08402154-aa3b-4815-843a-48a3cef38095 00000001:00080000:2.0:1788838098.196011:0:7611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1788838098.196399:0:7611:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788838098.338500:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838098.485381:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788838098.488656:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240380160 00000100:00100000:1.0:1788838098.488679:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240380160 00000100:00100000:1.0:1788838098.488811:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:1.0:1788838098.488824:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08402154-aa3b-4815-843a-48a3cef38095+7:13864:x1875732240380160:12345-192.168.204.54@tcp:41:lfs.0 00000004:00000024:1.0:1788838098.488895:0:15760:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788838098.489032:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08402154-aa3b-4815-843a-48a3cef38095+7:13864:x1875732240380160:12345-192.168.204.54@tcp:41:lfs.0 Request processed in 210us (3666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838098.489045:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00080000:2.0:1788838098.489166:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788838098.492314:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838098.492494:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240380288 00000100:00100000:2.0:1788838098.492509:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240380288 00000100:00080000:1.0:1788838098.492575:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838098.492617:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:2.0:1788838098.492630:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b09a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:08402154-aa3b-4815-843a-48a3cef38095+6:13864:x1875732240380288:12345-192.168.204.54@tcp:13:lfs.0 00002000:00000024:2.0:1788838098.492681:0:15030:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788838098.492798:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b09a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:08402154-aa3b-4815-843a-48a3cef38095+6:13864:x1875732240380288:12345-192.168.204.54@tcp:13:lfs.0 Request processed in 170us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838098.492807:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:0.0:1788838098.499460:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838098.500093:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240380416 00000100:00100000:2.0:1788838098.500107:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240380416 00000100:00080000:1.0:1788838098.500237:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838098.500260:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:2.0:1788838098.500273:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:08402154-aa3b-4815-843a-48a3cef38095+5:13864:x1875732240380416:12345-192.168.204.54@tcp:13:lfs.0 00002000:00000024:2.0:1788838098.500308:0:15030:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788838098.500428:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:08402154-aa3b-4815-843a-48a3cef38095+5:13864:x1875732240380416:12345-192.168.204.54@tcp:13:lfs.0 Request processed in 157us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838098.500437:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:3.0:1788838098.594689:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788838098.594725:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255054080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788838098.594825:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838098.594998:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255054080 00000100:00100000:1.0:1788838098.595008:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255054080 00000100:00100000:1.0:1788838098.595080:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788838098.595092:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255054080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788838098.595125:0:15030:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788838098.595187:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255054080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838098.595194:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788838098.595368:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255054080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788838098.680165:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788838098.680434:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240380544 00000100:00100000:1.0:1788838098.680448:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240380544 00000100:00100000:1.0:1788838098.680524:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 92 00000100:00100000:1.0:1788838098.680536:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47c8f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+10:13894:x1875732240380544:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788838098.680578:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838098.680601:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a458d3ca00/0x2deb895b363e770d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d3f8 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838098.680640:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a458d3ca00/0x2deb895b363e770d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d3f8 expref: 11 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838098.680654:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a458d3ca00/0x2deb895b363e770d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d3f8 expref: 11 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838098.680664:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3ca00, rc 0) 00000100:00100000:1.0:1788838098.680747:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47c8f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+11:13894:x1875732240380544:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 213us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838098.680756:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 92 00000100:00100000:1.0:1788838098.686349:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838098.686519:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240380672 00000100:00100000:2.0:1788838098.686557:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240380672 00000100:00100000:2.0:1788838098.686629:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 93 00000100:00100000:2.0:1788838098.686640:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47c8f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+11:13894:x1875732240380672:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788838098.687069:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47c8f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+11:13894:x1875732240380672:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 429us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838098.687082:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 93 00000100:00100000:0.0:1788838098.691738:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838098.691886:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240380800 00000100:00100000:2.0:1788838098.691906:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240380800 00000100:00100000:2.0:1788838098.692033:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 94 00000100:00100000:2.0:1788838098.692048:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47c8f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+11:13894:x1875732240380800:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788838098.693794:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47c8f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+11:13894:x1875732240380800:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 1736us (2056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838098.693810:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 94 00000100:00100000:3.0:1788838098.708805:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788838098.712991:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240380928 00000100:00100000:1.0:1788838098.713015:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240380928 00000100:00100000:1.0:1788838098.713138:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 95 00000100:00100000:1.0:1788838098.713152:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47c8f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+11:13902:x1875732240380928:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788838098.713626:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47c8f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+11:13902:x1875732240380928:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 474us (5425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838098.713636:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 95 00000100:00100000:1.0:1788838098.753471:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838098.753660:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240381056 00000100:00100000:2.0:1788838098.753674:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240381056 00000100:00100000:2.0:1788838098.753755:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 96 00000100:00100000:2.0:1788838098.753768:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47c8f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+11:13902:x1875732240381056:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788838098.754155:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47c8f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+11:13902:x1875732240381056:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 388us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838098.754166:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 96 00000100:00100000:0.0:1788838098.769413:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838098.769720:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240381184 00000100:00100000:3.0:1788838098.769734:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240381184 00000100:00100000:3.0:1788838098.769805:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 97 00000100:00100000:3.0:1788838098.769817:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47c8f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+11:13894:x1875732240381184:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788838098.769841:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838098.769879:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a44a48b800/0x2deb895b363e7714 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d422 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838098.769921:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a44a48b800/0x2deb895b363e7714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d422 expref: 12 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838098.769935:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a44a48b800/0x2deb895b363e7714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d422 expref: 12 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838098.769947:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48b800, rc 0) 00000100:00100000:3.0:1788838098.770030:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47c8f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+12:13894:x1875732240381184:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 215us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838098.770037:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 97 00000100:00100000:2.0:1788838098.775466:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788838098.775928:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240381312 00000100:00100000:1.0:1788838098.775942:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240381312 00000100:00100000:1.0:1788838098.776019:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 98 00000100:00100000:1.0:1788838098.776030:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47c8f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+12:13894:x1875732240381312:12345-192.168.204.54@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788838098.776095:0:14333:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788838098.776118:0:14333:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788838098.776123:0:14333:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788838098.776127:0:14333:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788838098.776129:0:14333:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788838098.782119:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47c8f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+12:13894:x1875732240381312:12345-192.168.204.54@tcp:256:mount.lustre.0 Request processed in 5538us (6116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838098.782156:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 98 00000100:00100000:0.0:1788838098.784574:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838098.784691:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240381440 00000100:00100000:2.0:1788838098.784703:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240381440 00000100:00100000:2.0:1788838098.784774:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 99 00000100:00100000:2.0:1788838098.784787:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47c8f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+12:13894:x1875732240381440:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788838098.784832:0:14332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838098.784859:0:14332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a47bbb4a00/0x2deb895b363e771b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d429 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838098.784908:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a47bbb4a00/0x2deb895b363e771b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d429 expref: 13 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838098.784921:0:14332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a47bbb4a00/0x2deb895b363e771b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d429 expref: 13 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838098.784931:0:14332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4a00, rc 0) 00000100:00100000:2.0:1788838098.785012:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47c8f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+13:13894:x1875732240381440:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 227us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838098.785020:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 99 00000100:00100000:2.0:1788838098.786941:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788838098.787070:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240381568 00000100:00100000:0.0:1788838098.787081:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240381568 00000100:00100000:0.0:1788838098.787162:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 100 00000100:00100000:0.0:1788838098.787174:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a451d70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+13:13894:x1875732240381568:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788838098.787979:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a451d70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+13:13894:x1875732240381568:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 801us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838098.787991:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 100 00000100:00100000:1.0:1788838098.794636:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838098.794723:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240381696 00000100:00100000:3.0:1788838098.794737:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240381696 00000100:00100000:3.0:1788838098.794856:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 101 00000100:00100000:3.0:1788838098.794880:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a451d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+13:13894:x1875732240381696:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788838098.795236:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a451d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+13:13894:x1875732240381696:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 367us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838098.795245:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 101 00000100:00100000:3.0:1788838098.804463:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788838098.804585:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240381824 00000100:00100000:0.0:1788838098.804600:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240381824 00000100:00100000:0.0:1788838098.804676:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 102 00000100:00100000:0.0:1788838098.804689:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a451d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+13:13907:x1875732240381824:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788838098.805381:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a451d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+13:13907:x1875732240381824:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 691us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838098.805391:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 102 00000100:00100000:0.0:1788838098.816804:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838098.817713:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240381952 00000100:00100000:3.0:1788838098.817728:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240381952 00000100:00100000:3.0:1788838098.817809:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 103 00000100:00100000:3.0:1788838098.817823:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a451d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+13:13907:x1875732240381952:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788838098.818345:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a451d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+13:13907:x1875732240381952:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 372us (1404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838098.818357:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 103 00000100:00100000:1.0:1788838098.825164:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838098.825314:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240382080 00000100:00100000:2.0:1788838098.825329:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240382080 00000100:00100000:2.0:1788838098.825395:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:2.0:1788838098.825406:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b09b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2348:x1875732240382080:12345-192.168.204.54@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788838098.825447:0:14341:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 820a2285-a5f5-467b-86b4-a6c9f6481f5b@192.168.204.54@tcp t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:2.0:1788838098.825505:0:14341:0:(genops.c:1385:class_connect()) connect: client 820a2285-a5f5-467b-86b4-a6c9f6481f5b, cookie 0x2deb895b363e7722 00000004:00100000:2.0:1788838098.825548:0:14341:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788838098.825712:0:14341:0:(import.c:65:import_set_state_nolock()) ffff97a47af56800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788838098.825811:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b09b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:820a2285-a5f5-467b-86b4-a6c9f6481f5b+6:2348:x1875732240382080:12345-192.168.204.54@tcp:38:mount.lustre.0 Request processed in 404us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838098.825820:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:0.0:1788838098.835290:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788838098.835933:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240382208 00000100:00100000:1.0:1788838098.835948:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240382208 00000100:00100000:1.0:1788838098.836066:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:1.0:1788838098.836078:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:820a2285-a5f5-467b-86b4-a6c9f6481f5b+6:0:x1875732240382208:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788838098.836124:0:15760:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788838098.836282:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:820a2285-a5f5-467b-86b4-a6c9f6481f5b+6:0:x1875732240382208:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 205us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838098.836290:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00080000:2.0:1788838098.837463:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788838098.837899:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838098.838053:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240382336 00000100:00100000:2.0:1788838098.838063:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240382336 00000100:00100000:2.0:1788838098.838118:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:2.0:1788838098.838128:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:820a2285-a5f5-467b-86b4-a6c9f6481f5b+6:13894:x1875732240382336:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788838098.838160:0:14342:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788838098.838275:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:820a2285-a5f5-467b-86b4-a6c9f6481f5b+6:13894:x1875732240382336:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 147us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838098.838283:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:1.0:1788838098.843329:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788838098.843447:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240382464 00000100:00100000:0.0:1788838098.843461:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240382464 00000100:00100000:0.0:1788838098.843539:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:0.0:1788838098.843551:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b09b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:820a2285-a5f5-467b-86b4-a6c9f6481f5b+6:13894:x1875732240382464:12345-192.168.204.54@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788838098.843674:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b09b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:820a2285-a5f5-467b-86b4-a6c9f6481f5b+6:13894:x1875732240382464:12345-192.168.204.54@tcp:40:mount.lustre.0 Request processed in 125us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838098.843703:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:0.0:1788838098.848484:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788838098.848530:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788838098.848657:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838098.848785:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240382848 00000100:00100000:2.0:1788838098.848799:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240382848 00000100:00100000:2.0:1788838098.848861:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:2.0:1788838098.848882:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:820a2285-a5f5-467b-86b4-a6c9f6481f5b+6:13894:x1875732240382848:12345-192.168.204.54@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788838098.848987:0:14344:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788838098.849100:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:820a2285-a5f5-467b-86b4-a6c9f6481f5b+6:13894:x1875732240382848:12345-192.168.204.54@tcp:33:mount.lustre.0 Request processed in 220us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838098.849107:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:3.0:1788838098.851834:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240382592 00000100:00100000:3.0:1788838098.851851:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240382592 00000100:00100000:3.0:1788838098.851913:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240382720 00000100:00100000:3.0:1788838098.851917:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240382720 00000100:00100000:3.0:1788838098.851951:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:3.0:1788838098.851961:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1875732240382592:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788838098.851999:0:15029:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 820a2285-a5f5-467b-86b4-a6c9f6481f5b@192.168.204.54@tcp t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:3.0:1788838098.852039:0:15029:0:(genops.c:1385:class_connect()) connect: client 820a2285-a5f5-467b-86b4-a6c9f6481f5b, cookie 0x2deb895b363e7729 00000100:00100000:0.0:1788838098.852220:0:15567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:0.0:1788838098.852228:0:15567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1875732240382720:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788838098.852245:0:15567:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 820a2285-a5f5-467b-86b4-a6c9f6481f5b@192.168.204.54@tcp t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:0.0:1788838098.852269:0:15567:0:(genops.c:1385:class_connect()) connect: client 820a2285-a5f5-467b-86b4-a6c9f6481f5b, cookie 0x2deb895b363e7730 00002000:00100000:3.0:1788838098.852489:0:15029:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 820a2285-a5f5-467b-86b4-a6c9f6481f5b/ffff97a344b30000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113975 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788838098.852505:0:15029:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788838098.852658:0:15029:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788838098.852705:0:15029:0:(import.c:65:import_set_state_nolock()) ffff97a47af70000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788838098.852787:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:820a2285-a5f5-467b-86b4-a6c9f6481f5b+6:2348:x1875732240382592:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 826us (4318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838098.852796:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00002000:00100000:0.0:1788838098.853243:0:15567:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 820a2285-a5f5-467b-86b4-a6c9f6481f5b/ffff97a448f83800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113975 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788838098.853253:0:15567:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788838098.853497:0:15567:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788838098.853522:0:15567:0:(import.c:65:import_set_state_nolock()) ffff97a345203800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788838098.853558:0:15567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:820a2285-a5f5-467b-86b4-a6c9f6481f5b+6:2348:x1875732240382720:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 1329us (5027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838098.853566:0:15567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:0.0:1788838098.991428:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838098.991602:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240382976 00000100:00100000:2.0:1788838098.991617:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240382976 00000100:00100000:2.0:1788838098.991696:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:2.0:1788838098.991709:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:820a2285-a5f5-467b-86b4-a6c9f6481f5b+6:13928:x1875732240382976:12345-192.168.204.54@tcp:101:mkdir.0 00010000:00010000:2.0:1788838098.991737:0:14342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838098.991768:0:14342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e7737 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d453 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838098.991859:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e773e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838098.991914:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e773e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838098.991931:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e773e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838098.991977:0:14342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788838098.991981:0:14342:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788838098.992008:0:14342:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e773e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838098.992038:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e7737 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d453 expref: 8 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838098.992061:0:14342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e773e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d453 expref: 7 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838098.992072:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a461771f00) 00010000:00010000:2.0:1788838098.992075:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788838098.992079:0:14342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4400, rc 0) 00000100:00100000:2.0:1788838098.992164:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:820a2285-a5f5-467b-86b4-a6c9f6481f5b+7:13928:x1875732240382976:12345-192.168.204.54@tcp:101:mkdir.0 Request processed in 458us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838098.992170:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00010000:00010000:2.0:1788838099.362992:0:16053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838100.386505:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788838100.714138:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 820a2285-a5f5-467b-86b4-a6c9f6481f5b 00000001:00100000:3.0:1788838100.714157:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 08402154-aa3b-4815-843a-48a3cef38095 00010000:00010000:0.0:1788838101.414825:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788838101.722485:0:5830:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 820a2285-a5f5-467b-86b4-a6c9f6481f5b 00000001:00100000:2.0:1788838101.722502:0:5830:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 08402154-aa3b-4815-843a-48a3cef38095 00000001:02000400:1.0:1788838101.959890:0:16313:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788838102.434343:0:16053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838103.202391:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255054464:0@lo:400:kworker.0 00000100:00100000:2.0:1788838103.202455:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255054336:0@lo:400:kworker.0 00000100:00100000:3.0:1788838103.202489:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838103.202615:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3271:1875732255054208:0@lo:400:kworker.0 00000100:00100000:2.0:1788838103.205310:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3274:1875732255054592:0@lo:400:kworker.0 00000100:00100000:1.0:1788838103.208089:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838103.208116:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838103.208186:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732255054720:0@lo:400:kworker.0 00000100:00100000:2.0:1788838103.208192:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788838103.208225:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46ed7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255054976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788838103.208238:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838103.208318:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255054208 00000100:00100000:2.0:1788838103.208325:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838103.208326:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255054208 00000100:00100000:2.0:1788838103.208366:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255054592 00000100:00100000:2.0:1788838103.208371:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255054592 00000100:00100000:1.0:1788838103.208384:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788838103.208395:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a451d71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+19:3271:x1875732255054208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838103.208405:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255054720 00000100:00100000:2.0:1788838103.208410:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255054720 00000100:00100000:2.0:1788838103.208440:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788838103.208448:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1875732255054592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838103.208472:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a451d71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+19:3271:x1875732255054208:12345-0@lo:400:kworker.0 Request processed in 79us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838103.208481:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788838103.208522:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788838103.208530:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732255054720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838103.208561:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3271:x1875732255054720:12345-0@lo:400:kworker.0 Request processed in 33us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838103.208566:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788838103.208585:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255054976 00000100:00100000:1.0:1788838103.208589:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255054976 00000100:00100000:1.0:1788838103.208614:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788838103.208621:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732255054976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788838103.208649:0:15030:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788838103.208679:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732255054976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838103.208685:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788838103.208934:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1875732255054592:12345-0@lo:400:kworker.0 Request processed in 55us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838103.208945:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788838103.208970:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788838103.208980:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788838103.209098:0:3274:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788838103.209125:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46ed7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255054976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788838103.209145:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3274:1875732255054592:0@lo:400:kworker.0 00000100:00100000:0.0:1788838103.209307:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3271:1875732255054208:0@lo:400:kworker.0 00000100:00100000:0.0:1788838103.209321:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3271:1875732255054720:0@lo:400:kworker.0 00000100:00100000:2.0:1788838103.220333:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255054464 00000100:00100000:2.0:1788838103.220348:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255054464 00000100:00100000:2.0:1788838103.220413:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788838103.220425:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255054464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838103.220517:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255054464:12345-0@lo:400:kworker.0 Request processed in 95us (18029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838103.220523:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788838103.220566:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838103.220604:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47b850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3272:1875732255054848:0@lo:400:kworker.0 00000100:00100000:2.0:1788838103.220639:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838103.220733:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255054336 00000100:00100000:1.0:1788838103.220739:0:15027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255054336 00000100:00100000:1.0:1788838103.220791:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788838103.220801:0:15027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255054336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838103.220818:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255054848 00000100:00100000:2.0:1788838103.220824:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255054848 00000100:00100000:1.0:1788838103.220851:0:15027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255054336:12345-0@lo:400:kworker.0 Request processed in 52us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838103.220859:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788838103.220863:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788838103.220873:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3272:x1875732255054848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838103.220909:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3272:x1875732255054848:12345-0@lo:400:kworker.0 Request processed in 40us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838103.220915:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788838103.220930:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788838103.220936:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838103.220960:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255054336:0@lo:400:kworker.0 00000100:00100000:2.0:1788838103.220971:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3272:1875732255054848:0@lo:400:kworker.0 00000100:00100000:3.0:1788838103.222841:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47b853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255054464:0@lo:400:kworker.0 00000001:00100000:1.0:1788838103.311600:0:7611:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 820a2285-a5f5-467b-86b4-a6c9f6481f5b 00010000:00010000:1.0:1788838103.461550:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838103.714657:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788838103.714681:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47fc55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255055104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788838103.714762:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838103.714843:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255055104 00000100:00100000:1.0:1788838103.714851:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255055104 00000100:00100000:1.0:1788838103.714897:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788838103.714907:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255055104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788838103.714943:0:15030:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788838103.714990:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255055104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838103.714998:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788838103.715043:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47fc55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255055104:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788838104.102988:0:14371:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788838104.264423:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838104.264466:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838104.264503:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838104.264616:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240383232 00000100:00100000:2.0:1788838104.264626:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240383232 00000100:00100000:2.0:1788838104.264694:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:2.0:1788838104.264704:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08402154-aa3b-4815-843a-48a3cef38095+6:2350:x1875732240383232:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788838104.264705:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838104.264725:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838104.264792:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08402154-aa3b-4815-843a-48a3cef38095+6:2350:x1875732240383232:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 89us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838104.264799:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:2.0:1788838104.264922:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240383104 00000100:00100000:2.0:1788838104.264927:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240383104 00000100:00100000:2.0:1788838104.264966:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 105 00000100:00100000:2.0:1788838104.264973:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a451d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+13:2350:x1875732240383104:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788838104.265005:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a451d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+13:2350:x1875732240383104:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 32us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838104.265031:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 105 00000100:00100000:3.0:1788838104.265555:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838104.265579:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788838104.265899:0:15567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240383488 00000100:00100000:1.0:1788838104.265906:0:15567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240383488 00000100:00100000:1.0:1788838104.265950:0:15567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240383744 00000100:00100000:1.0:1788838104.265954:0:15567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240383744 00000100:00100000:1.0:1788838104.265969:0:15567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240383360 00000100:00100000:1.0:1788838104.265972:0:15567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240383360 00000100:00100000:1.0:1788838104.265989:0:15567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:1.0:1788838104.265997:0:15567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08402154-aa3b-4815-843a-48a3cef38095+5:2350:x1875732240383488:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788838104.266049:0:15567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08402154-aa3b-4815-843a-48a3cef38095+5:2350:x1875732240383488:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 53us (1582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838104.266057:0:15567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:1.0:1788838104.266071:0:15567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:1.0:1788838104.266077:0:15567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:820a2285-a5f5-467b-86b4-a6c9f6481f5b+5:2350:x1875732240383744:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788838104.266114:0:15567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:820a2285-a5f5-467b-86b4-a6c9f6481f5b+5:2350:x1875732240383744:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 37us (1611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838104.266120:0:15567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:1.0:1788838104.266132:0:15567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:1.0:1788838104.266137:0:15567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08402154-aa3b-4815-843a-48a3cef38095+5:2350:x1875732240383360:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788838104.266157:0:15567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08402154-aa3b-4815-843a-48a3cef38095+5:2350:x1875732240383360:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 19us (1431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838104.266162:0:15567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00080000:1.0:1788838104.266181:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788838104.266186:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788838104.266188:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788838104.270266:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240383616 00000100:00100000:2.0:1788838104.270283:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240383616 00000100:00100000:2.0:1788838104.270384:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:2.0:1788838104.270412:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:820a2285-a5f5-467b-86b4-a6c9f6481f5b+6:2350:x1875732240383616:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788838104.270508:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:820a2285-a5f5-467b-86b4-a6c9f6481f5b+6:2350:x1875732240383616:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 114us (4958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838104.270516:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00080000:0.0:1788838104.271843:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788838104.272451:0:15567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240383872 00000100:00100000:0.0:1788838104.272461:0:15567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240383872 00000100:00100000:0.0:1788838104.272539:0:15567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:0.0:1788838104.272561:0:15567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:820a2285-a5f5-467b-86b4-a6c9f6481f5b+5:2350:x1875732240383872:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788838104.272635:0:15567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:820a2285-a5f5-467b-86b4-a6c9f6481f5b+5:2350:x1875732240383872:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 76us (7054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838104.272642:0:15567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00080000:3.0:1788838104.272920:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788838104.488753:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838105.507757:0:16053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788838105.556801:0:16461:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca103b8e0 20000000:00000080:0.0:1788838105.556819:0:16461:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97a345a68800 uarg=0000000000000000 20000000:01000000:0.0:1788838105.556858:0:16461:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788838105.556865:0:16461:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788838105.556870:0:16461:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788838105.557709:0:16462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1788838105.557891:0:16461:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788838105.567839:0:16461:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788838105.568009:0:16461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a44a48be00/0x2deb895b363e7745 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838105.568031:0:16461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a458d3de00/0x2deb895b363e743c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e7435 expref: 18 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838105.568038:0:16461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a46e790c00/0x2deb895b363e7489 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e7482 expref: 18 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838105.568045:0:16461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a46e790e00/0x2deb895b363e75bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e75b6 expref: 18 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838105.568053:0:16461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a458d3c800/0x2deb895b363e76e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d3c7 expref: 12 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838105.568060:0:16461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a47bbb4a00/0x2deb895b363e771b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d429 expref: 12 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838105.568067:0:16461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a44a48be00/0x2deb895b363e7745 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838105.568133:0:16461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a47bbb4a00/0x2deb895b363e771b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d429 expref: 12 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838105.568153:0:16461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a47bbb4a00/0x2deb895b363e771b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d429 expref: 12 pid: 14332 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838105.568167:0:16461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a45108e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16461:1875732255055232:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788838105.568315:0:16461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a458d3c800/0x2deb895b363e76e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d3c7 expref: 12 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838105.568324:0:16461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a458d3c800/0x2deb895b363e76e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d3c7 expref: 12 pid: 14333 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838105.568333:0:16461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a45108ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16461:1875732255055360:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788838105.568364:0:16461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a46e790e00/0x2deb895b363e75bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e75b6 expref: 18 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838105.568372:0:16461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a46e790e00/0x2deb895b363e75bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e75b6 expref: 18 pid: 14332 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838105.568381:0:16461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a45108e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16461:1875732255055488:0@lo:104: 00000100:00100000:3.0:1788838105.568423:0:16461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788838105.568471:0:16461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a46e790c00/0x2deb895b363e7489 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e7482 expref: 18 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838105.568478:0:16461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a46e790c00/0x2deb895b363e7489 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e7482 expref: 18 pid: 14332 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838105.568500:0:16461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a45108df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16461:1875732255055616:0@lo:104: 00000100:00100000:3.0:1788838105.568523:0:16461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788838105.568559:0:16461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a458d3de00/0x2deb895b363e743c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2deb895b363e7435 expref: 18 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838105.568567:0:16461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a458d3de00/0x2deb895b363e743c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2deb895b363e7435 expref: 18 pid: 14333 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838105.568575:0:16461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a45108dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16461:1875732255055744:0@lo:104: 00000100:00100000:3.0:1788838105.568604:0:16461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838105.568614:0:16461:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a345895840 going to sleep for 11 seconds 00000100:00100000:0.0:1788838105.568717:0:14324:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788838105.568732:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255055488 00000100:00100000:0.0:1788838105.568754:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255055488 00000100:00100000:0.0:1788838105.568794:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255055616 00000100:00100000:0.0:1788838105.568798:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255055616 00000100:00100000:0.0:1788838105.568808:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255055744 00000100:00100000:0.0:1788838105.568810:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255055744 00000100:00100000:0.0:1788838105.568823:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788838105.568832:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+5:16461:x1875732255055488:12345-0@lo:104: 00010000:00010000:0.0:1788838105.568844:0:14324:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a44a48b400/0x2deb895b363e75b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e75bd expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838105.568895:0:14324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788838105.568901:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+5:16461:x1875732255055488:12345-0@lo:104: Request processed in 71us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838105.568908:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788838105.568925:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788838105.568932:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+4:16461:x1875732255055616:12345-0@lo:104: 00010000:00010000:0.0:1788838105.568948:0:14324:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a47bbb5000/0x2deb895b363e7482 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e7489 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838105.568982:0:14324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788838105.568987:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+4:16461:x1875732255055616:12345-0@lo:104: Request processed in 57us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838105.568993:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788838105.569006:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788838105.569013:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a4496bb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+3:16461:x1875732255055744:12345-0@lo:104: 00010000:00010000:0.0:1788838105.569020:0:14324:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4200/0x2deb895b363e7435 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e743c expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838105.569053:0:14324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788838105.569058:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a4496bb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+3:16461:x1875732255055744:12345-0@lo:104: Request processed in 46us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838105.569064:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788838105.569102:0:16053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788838105.569107:0:16053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a44a48b400/0x2deb895b363e75b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e75bd expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838105.569115:0:16053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48b400 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:0.0:1788838105.569119:0:16053:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a44a48b400/0x2deb895b363e75b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e75bd expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838105.569126:0:16053:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a44a48b400/0x2deb895b363e75b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e75bd expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838105.569134:0:16053:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a44a48b400/0x2deb895b363e75b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e75bd expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838105.569147:0:16053:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788838105.569177:0:16053:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a44a48b400/0x2deb895b363e75b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e75bd expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838105.569184:0:16053:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788838105.569228:0:16053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a44a48b400/0x2deb895b363e75b6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e75bd expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838105.569235:0:16053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a44a48b400/0x2deb895b363e75b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e75bd expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838105.569250:0:16053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788838105.569253:0:16053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a47bbb5000/0x2deb895b363e7482 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e7489 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838105.569259:0:16053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5000 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:0.0:1788838105.569262:0:16053:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a47bbb5000/0x2deb895b363e7482 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e7489 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838105.569269:0:16053:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a47bbb5000/0x2deb895b363e7482 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e7489 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838105.569275:0:16053:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a47bbb5000/0x2deb895b363e7482 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e7489 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838105.569280:0:16053:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788838105.569292:0:16053:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a47bbb5000/0x2deb895b363e7482 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e7489 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838105.569298:0:16053:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788838105.569311:0:16053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a47bbb5000/0x2deb895b363e7482 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e7489 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838105.569317:0:16053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a47bbb5000/0x2deb895b363e7482 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e7489 expref: -99 pid: 15025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838105.569326:0:16053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838105.569328:0:16053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4200/0x2deb895b363e7435 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2deb895b363e743c expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838105.569333:0:16053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4200 already unused, calling callback (ffffffffc1c12c20) 10000000:00010000:0.0:1788838105.569336:0:16053:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4200/0x2deb895b363e7435 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2deb895b363e743c expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838105.569342:0:16053:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4200/0x2deb895b363e7435 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2deb895b363e743c expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838105.569349:0:16053:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4200/0x2deb895b363e7435 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2deb895b363e743c expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838105.569354:0:16053:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788838105.569367:0:16053:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4200/0x2deb895b363e7435 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e743c expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838105.569372:0:16053:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788838105.569388:0:16053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4200/0x2deb895b363e7435 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e743c expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838105.569394:0:16053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4200/0x2deb895b363e7435 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2deb895b363e743c expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838105.569417:0:16053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838105.569419:0:16053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838105.569420:0:16053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838105.569432:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3271:1875732255055872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838105.569461:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838105.569491:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788838105.569497:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3271:1875732255056000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838105.569517:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838105.569540:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788838105.569548:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3274:1875732255056128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838105.569569:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838105.569606:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255055872 00000100:00100000:0.0:1788838105.569610:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255055872 00010000:00010000:0.0:1788838105.569627:0:14326:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a46e790e00/0x2deb895b363e75bd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e75b6 expref: 19 pid: 14332 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838105.569641:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255056000 00000100:00100000:0.0:1788838105.569643:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255056000 00010000:00010000:0.0:1788838105.569654:0:14326:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a46e790c00/0x2deb895b363e7489 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e7482 expref: 20 pid: 14332 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838105.569663:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255056128 00000100:00100000:0.0:1788838105.569666:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255056128 00010000:00010000:0.0:1788838105.569675:0:14326:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a458d3de00/0x2deb895b363e743c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e7435 expref: 21 pid: 14333 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838105.569687:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788838105.569693:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+21:3271:x1875732255055872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838105.569709:0:14326:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838105.569715:0:14326:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a46e790e00/0x2deb895b363e75bd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e75b6 expref: 21 pid: 14332 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838105.569724:0:14326:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a46e790e00/0x2deb895b363e75bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e75b6 expref: 21 pid: 14332 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838105.569751:0:14326:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838105.569779:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+21:3271:x1875732255055872:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838105.569786:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788838105.569799:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788838105.569804:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+20:3271:x1875732255056000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838105.569811:0:14326:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838105.569815:0:14326:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a46e790c00/0x2deb895b363e7489 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e7482 expref: 20 pid: 14332 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838105.569823:0:14326:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a46e790c00/0x2deb895b363e7489 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e7482 expref: 20 pid: 14332 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838105.569831:0:14326:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838105.569852:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+20:3271:x1875732255056000:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838105.569859:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788838105.569871:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788838105.569877:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47baea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+19:3274:x1875732255056128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838105.569884:0:14326:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838105.569888:0:14326:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a458d3de00/0x2deb895b363e743c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2deb895b363e7435 expref: 19 pid: 14333 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838105.569902:0:14326:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a458d3de00/0x2deb895b363e743c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2deb895b363e7435 expref: 19 pid: 14333 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838105.569911:0:14326:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838105.569937:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47baea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+19:3274:x1875732255056128:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838105.569943:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788838105.570000:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3274:1875732255056128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838105.570025:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3271:1875732255056000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838105.570032:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3271:1875732255055872:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788838105.570235:0:16461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a46e790e00/0x2deb895b363e75bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e75b6 expref: 18 pid: 14332 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838105.570246:0:16461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a45108e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16461:1875732255055488:0@lo:104: 00010000:00010000:3.0:1788838105.570254:0:16461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a46e790c00/0x2deb895b363e7489 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e7482 expref: 17 pid: 14332 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838105.570262:0:16461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a45108df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16461:1875732255055616:0@lo:104: 00010000:00010000:3.0:1788838105.570269:0:16461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a458d3de00/0x2deb895b363e743c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2deb895b363e7435 expref: 16 pid: 14333 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838105.570276:0:16461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a45108dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16461:1875732255055744:0@lo:104: 00010000:00010000:0.0:1788838105.572366:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838105.572374:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838105.579751:0:16461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a45108e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16461:1875732255055232:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788838105.585134:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838105.585257:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788838105.585400:0:16461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a45108ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16461:1875732255055360:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788838105.585442:0:16461:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a44a48be00/0x2deb895b363e7745 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838105.585602:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240384128 00000100:00100000:1.0:1788838105.585610:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240384128 00010000:00010000:1.0:1788838105.585647:0:14325:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a458d3c800/0x2deb895b363e76e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d3c7 expref: 13 pid: 14333 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838105.585684:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240384000 00000100:00100000:1.0:1788838105.585687:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240384000 00010000:00010000:1.0:1788838105.585699:0:14325:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a47bbb4a00/0x2deb895b363e771b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d429 expref: 14 pid: 14332 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838105.585714:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:1.0:1788838105.585724:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+14:2352:x1875732240384128:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788838105.585749:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838105.585755:0:14325:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a458d3c800/0x2deb895b363e76e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d3c7 expref: 14 pid: 14333 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838105.585784:0:14325:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a458d3c800/0x2deb895b363e76e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d3c7 expref: 14 pid: 14333 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838105.585803:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a458d3c800/0x2deb895b363e76e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d3c7 expref: 14 pid: 14333 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838105.585818:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838105.585882:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+13:2352:x1875732240384128:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 159us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838105.585889:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:1.0:1788838105.585907:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:1.0:1788838105.585913:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+12:2351:x1875732240384000:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788838105.585921:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838105.585925:0:14325:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a47bbb4a00/0x2deb895b363e771b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d429 expref: 12 pid: 14332 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838105.585935:0:14325:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a47bbb4a00/0x2deb895b363e771b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d429 expref: 12 pid: 14332 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838105.585944:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a47bbb4a00/0x2deb895b363e771b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d429 expref: 12 pid: 14332 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838105.585955:0:14325:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a44a48be00/0x2deb895b363e7745 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838105.585964:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a44a48be00/0x2deb895b363e7745 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838105.585988:0:14325:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a44a48be00/0x2deb895b363e7745 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838105.585995:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a44a48be00/0x2deb895b363e7745 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838105.586002:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a44a48be00/0x2deb895b363e7745 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838105.586008:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a44a48be00/0x2deb895b363e7745 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838105.586014:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48be00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:1.0:1788838105.586018:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a44a48be00/0x2deb895b363e7745 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838105.586026:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a44a48be00/0x2deb895b363e7745 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838105.586037:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a44a48be00/0x2deb895b363e7745 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838105.586045:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788838105.586289:0:16461:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97a44a48be00/0x2deb895b363e7745 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838105.586298:0:16461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a44a48be00/0x2deb895b363e7745 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838105.586304:0:16461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a44a48be00/0x2deb895b363e7745 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838105.587238:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+11:2351:x1875732240384000:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 1317us (1973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838105.587248:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00010000:00010000:0.0:1788838106.530733:0:16053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838106.891336:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838106.892015:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240384256 00000100:00100000:2.0:1788838106.892027:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240384256 00000100:00100000:2.0:1788838106.892088:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 106 00000100:00100000:2.0:1788838106.892098:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a451d72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+11:13782:x1875732240384256:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838106.892115:0:14332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838106.892135:0:14332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a47bbb5600/0x2deb895b363e774c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d45a expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838106.892164:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a47bbb5600/0x2deb895b363e774c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d45a expref: 12 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838106.892176:0:14332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a47bbb5600/0x2deb895b363e774c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d45a expref: 12 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838106.892198:0:14332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5600, rc 0) 00000100:00100000:2.0:1788838106.893095:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a451d72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+12:13782:x1875732240384256:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 992us (1762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838106.893105:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 106 00000100:00100000:2.0:1788838106.907196:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838106.907358:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240384384 00000100:00100000:3.0:1788838106.907369:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240384384 00000100:00100000:3.0:1788838106.907437:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 107 00000100:00100000:3.0:1788838106.907459:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a451d73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+12:13782:x1875732240384384:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838106.907762:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a451d73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+12:13782:x1875732240384384:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 303us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838106.907770:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 107 00000100:00100000:3.0:1788838106.916604:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838106.918251:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240384512 00000100:00100000:2.0:1788838106.918264:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240384512 00000100:00100000:2.0:1788838106.918315:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 108 00000100:00100000:2.0:1788838106.918326:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a451d70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+12:13782:x1875732240384512:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838106.918766:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a451d70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+12:13782:x1875732240384512:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 440us (2170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838106.918774:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 108 00000100:00100000:0.0:1788838106.929227:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838106.929330:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240384640 00000100:00100000:3.0:1788838106.929340:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240384640 00000100:00100000:3.0:1788838106.929399:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 109 00000100:00100000:3.0:1788838106.929411:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a451d71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+12:13782:x1875732240384640:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838106.929429:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838106.929449:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a44a48ae00/0x2deb895b363e7753 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d461 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838106.929481:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a44a48ae00/0x2deb895b363e7753 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d461 expref: 13 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838106.929494:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a44a48ae00/0x2deb895b363e7753 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d461 expref: 13 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838106.929503:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48ae00, rc 0) 00000100:00100000:3.0:1788838106.929561:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a451d71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+13:13782:x1875732240384640:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 152us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838106.929569:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 109 00000100:00100000:3.0:1788838106.931754:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838106.931802:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240384768 00000100:00100000:2.0:1788838106.931810:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240384768 00000100:00100000:2.0:1788838106.931862:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 110 00000100:00100000:2.0:1788838106.931871:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a451d71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+13:13782:x1875732240384768:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838106.932384:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a451d71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+13:13782:x1875732240384768:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 504us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838106.932392:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 110 00000100:00100000:1.0:1788838106.948355:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838106.955498:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240384896 00000100:00100000:3.0:1788838106.955514:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240384896 00000100:00100000:3.0:1788838106.955580:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 111 00000100:00100000:3.0:1788838106.955604:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a451d71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+13:13782:x1875732240384896:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838106.955846:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a451d71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+13:13782:x1875732240384896:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 243us (7500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838106.955854:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 111 10000000:01000000:2.0:1788838107.048260:0:14336:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788838107.048268:0:14336:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a4474f5800 from 10 10000000:01000000:2.0:1788838107.048273:0:14336:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788838107.048326:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4a00/0x2deb895b363e775a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838107.048359:0:14336:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4a00/0x2deb895b363e775a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838107.051404:0:14336:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4a00/0x2deb895b363e775a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838107.051445:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255056256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788838107.051523:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838107.051586:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4601b2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788838107.051616:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255056256 00000100:00100000:2.0:1788838107.051623:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255056256 00000100:00100000:2.0:1788838107.051673:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788838107.051684:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a451d72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+16:14336:x1875732255056256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838107.051700:0:14332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838107.051728:0:14332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a47bbb4200/0x2deb895b363e7761 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e775a expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838107.051754:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a47bbb4200/0x2deb895b363e7761 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e775a expref: 17 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838107.051766:0:14332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a47bbb4200/0x2deb895b363e7761 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e775a expref: 17 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838107.051775:0:14332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4200, rc 0) 00000100:00100000:2.0:1788838107.051815:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a451d72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+17:14336:x1875732255056256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838107.051822:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788838107.051881:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255056256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838107.051898:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4a00/0x2deb895b363e775a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e7761 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838107.052391:0:14336:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4a00/0x2deb895b363e775a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e7761 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838107.052463:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255056384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838107.052497:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838107.052514:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4601b2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788838107.052530:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255056384 00000100:00100000:2.0:1788838107.052535:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255056384 00000100:00100000:2.0:1788838107.052562:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788838107.052569:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a451d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+17:14336:x1875732255056384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838107.052858:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a451d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+17:14336:x1875732255056384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 288us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838107.052865:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788838107.052917:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255056384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838107.052951:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255056512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838107.052999:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838107.053019:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4601b2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788838107.053042:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255056512 00000100:00100000:2.0:1788838107.053046:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255056512 00000100:00100000:2.0:1788838107.053078:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788838107.053087:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a451d70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+17:14336:x1875732255056512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838107.053574:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a451d70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+17:14336:x1875732255056512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 486us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838107.053591:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788838107.053651:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255056512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788838107.054624:0:16523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788838107.054864:0:14336:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788838107.054883:0:14336:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788838107.055020:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4a00/0x2deb895b363e775a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e7761 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838107.055033:0:14336:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a47bbb4a00/0x2deb895b363e775a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e7761 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838107.055043:0:14336:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788838107.055046:0:14336:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a47b5ac000 from 10 10000000:01000000:2.0:1788838107.055049:0:14336:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788838107.055085:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a47bbb5000/0x2deb895b363e7768 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838107.055093:0:14336:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a47bbb5000/0x2deb895b363e7768 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838107.055102:0:14336:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a47bbb5000/0x2deb895b363e7768 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838107.055122:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255056640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788838107.055186:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838107.062017:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a44a56fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788838107.062052:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255056640 00000100:00100000:2.0:1788838107.062062:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255056640 00000100:00100000:2.0:1788838107.062129:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788838107.062986:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a0c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+17:14336:x1875732255056640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838107.063008:0:14332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838107.063028:0:14332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a47bbb5800/0x2deb895b363e776f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e7768 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838107.063058:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a47bbb5800/0x2deb895b363e776f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e7768 expref: 18 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838107.063069:0:14332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a47bbb5800/0x2deb895b363e776f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e7768 expref: 18 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838107.063079:0:14332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5800, rc 0) 00000100:00100000:2.0:1788838107.063785:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a0c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+18:14336:x1875732255056640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1647us (8596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838107.063795:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788838107.064025:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255056640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838107.064045:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a47bbb5000/0x2deb895b363e7768 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e776f expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838107.064056:0:14336:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a47bbb5000/0x2deb895b363e7768 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e776f expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838107.064129:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255056768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838107.064777:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838107.067039:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a44a70d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838107.069658:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255056768 00000100:00100000:2.0:1788838107.069673:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255056768 00000100:00100000:3.0:1788838107.069944:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788838107.069955:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46008a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+18:14336:x1875732255056768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838107.070545:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46008a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb679d1-2072-4f0b-b15a-39437d2c1c33+18:14336:x1875732255056768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 590us (5767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838107.070554:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788838107.070643:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255056768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838107.070692:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255056896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838107.070751:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838107.070789:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a44a70d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838107.070830:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255056896 00000100:00100000:3.0:1788838107.070835:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255056896 00000100:00100000:3.0:1788838107.070868:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788838107.070876:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46008a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+18:14336:x1875732255056896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838107.071113:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46008a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+18:14336:x1875732255056896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 238us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838107.071121:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788838107.074037:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255056896:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788838107.077948:0:16524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788838107.079130:0:14336:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788838107.079339:0:14336:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788838107.079353:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a47bbb5000/0x2deb895b363e7768 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e776f expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838107.079367:0:14336:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a47bbb5000/0x2deb895b363e7768 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e776f expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838107.079405:0:14336:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788838107.079407:0:14336:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a47b858800 from 10 10000000:01000000:0.0:1788838107.079411:0:14336:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788838107.079448:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a46e791400/0x2deb895b363e7776 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838107.079457:0:14336:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff97a46e791400/0x2deb895b363e7776 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838107.079468:0:14336:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff97a46e791400/0x2deb895b363e7776 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838107.079493:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255057024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788838107.079571:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838107.079615:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a44a70d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838107.079934:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255057024 00000100:00100000:0.0:1788838107.079942:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255057024 00000100:00100000:0.0:1788838107.079990:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788838107.080001:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a460089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+18:14336:x1875732255057024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838107.080015:0:14332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838107.080028:0:14332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a46e791e00/0x2deb895b363e777d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2deb895b363e7776 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838107.080120:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a46e791e00/0x2deb895b363e777d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2deb895b363e7776 expref: 19 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838107.080132:0:14332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a46e791e00/0x2deb895b363e777d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2deb895b363e7776 expref: 19 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838107.080250:0:14332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e791e00, rc 0) 00000100:00100000:0.0:1788838107.080295:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a460089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+19:14336:x1875732255057024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 296us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838107.080303:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788838107.080356:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255057024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838107.080567:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff97a46e791400/0x2deb895b363e7776 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e777d expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838107.080577:0:14336:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff97a46e791400/0x2deb895b363e7776 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2deb895b363e777d expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838107.080635:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255057152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838107.080666:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838107.080684:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a44a70d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838107.080698:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255057152 00000100:00100000:0.0:1788838107.080701:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255057152 00000100:00100000:0.0:1788838107.080961:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788838107.080969:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a460088c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+19:14336:x1875732255057152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838107.082295:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a460088c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+19:14336:x1875732255057152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1323us (1624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838107.082306:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788838107.082851:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255057152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838107.082916:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255057280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838107.082975:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838107.083015:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a44a70d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838107.083031:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255057280 00000100:00100000:0.0:1788838107.083118:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255057280 00000100:00100000:0.0:1788838107.083246:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788838107.083255:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a460089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+19:14336:x1875732255057280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838107.083511:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a460089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+19:14336:x1875732255057280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 256us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838107.083519:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788838107.083569:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfb679d1-2072-4f0b-b15a-39437d2c1c33:14336:1875732255057280:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788838107.091548:0:16527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788838107.091764:0:14336:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788838107.091785:0:14336:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788838107.091797:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff97a46e791400/0x2deb895b363e7776 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e777d expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838107.091808:0:14336:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff97a46e791400/0x2deb895b363e7776 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2deb895b363e777d expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838107.554523:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838108.322788:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788838108.322825:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a44765e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255057408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788838108.322889:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838108.322966:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255057408 00000100:00100000:1.0:1788838108.322974:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255057408 00000100:00100000:1.0:1788838108.323024:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788838108.323032:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255057408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788838108.323064:0:15030:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788838108.323104:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255057408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838108.323123:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788838108.323168:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a44765e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255057408:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788838108.326669:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838108.327531:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3274:1875732255057920:0@lo:400:kworker.0 00000100:00100000:2.0:1788838108.327605:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838108.327648:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788838108.327654:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3274:1875732255057792:0@lo:400:kworker.0 00000100:00100000:2.0:1788838108.327676:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838108.327723:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255057920 00000100:00100000:2.0:1788838108.327730:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255057920 00000100:00100000:2.0:1788838108.327777:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255057792 00000100:00100000:2.0:1788838108.327781:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255057792 00000100:00100000:2.0:1788838108.327802:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788838108.327810:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1875732255057920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838108.327875:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1875732255057920:12345-0@lo:400:kworker.0 Request processed in 65us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838108.327882:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788838108.327898:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788838108.327904:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1875732255057792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838108.327929:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1875732255057792:12345-0@lo:400:kworker.0 Request processed in 26us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838108.327936:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788838108.327980:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3274:1875732255057792:0@lo:400:kworker.0 00000100:00100000:2.0:1788838108.327991:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3274:1875732255057920:0@lo:400:kworker.0 00000100:00100000:1.0:1788838108.328078:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255057664:0@lo:400:kworker.0 00000100:00100000:1.0:1788838108.328108:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838108.328144:0:3272:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788838108.328150:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3272:1875732255057536:0@lo:400:kworker.0 00000100:00100000:1.0:1788838108.328175:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838108.328225:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3272:1875732255058048:0@lo:400:kworker.0 00000100:00100000:1.0:1788838108.328247:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838108.328273:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255057536 00000100:00100000:1.0:1788838108.328276:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255057536 00000100:00100000:1.0:1788838108.328304:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788838108.328310:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a460088050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+19:3272:x1875732255057536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838108.328361:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a460088050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfb679d1-2072-4f0b-b15a-39437d2c1c33+19:3272:x1875732255057536:12345-0@lo:400:kworker.0 Request processed in 51us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838108.328366:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788838108.328401:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3272:1875732255057536:0@lo:400:kworker.0 00000100:00100000:1.0:1788838108.328429:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255058048 00000100:00100000:1.0:1788838108.328433:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255058048 00000100:00100000:1.0:1788838108.328458:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788838108.328464:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3272:x1875732255058048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838108.328496:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3272:x1875732255058048:12345-0@lo:400:kworker.0 Request processed in 32us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838108.328502:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788838108.328525:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3272:1875732255058048:0@lo:400:kworker.0 00000100:00100000:2.0:1788838108.328651:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255057664 00000100:00100000:2.0:1788838108.328655:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255057664 00000100:00100000:2.0:1788838108.328702:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788838108.328709:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255057664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838108.328743:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255057664:12345-0@lo:400:kworker.0 Request processed in 35us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838108.328750:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788838108.329132:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255057664:0@lo:400:kworker.0 00000100:00080000:3.0:1788838108.329234:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788838108.329239:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788838108.578887:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838108.834462:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788838108.834490:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47fc55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255058176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788838108.834579:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838108.834852:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255058176 00000100:00100000:1.0:1788838108.834861:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255058176 00000100:00100000:1.0:1788838108.834913:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788838108.834923:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255058176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788838108.834962:0:15030:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788838108.835018:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255058176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838108.835025:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788838108.835190:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47fc55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255058176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788838109.386307:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788838109.386351:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788838109.386382:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788838109.386421:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788838109.386444:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788838109.386461:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788838109.386483:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788838109.386528:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240385024 00000100:00100000:0.0:1788838109.386537:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240385024 00000100:00100000:0.0:1788838109.386587:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00100000:0.0:1788838109.386597:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46008bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+13:2351:x1875732240385024:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788838109.386682:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46008bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+13:2351:x1875732240385024:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 86us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838109.386690:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00100000:1.0:1788838109.386794:0:15567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240385408 00000100:00100000:1.0:1788838109.386799:0:15567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240385408 00000100:00100000:1.0:1788838109.386841:0:15567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240385664 00000100:00100000:1.0:1788838109.386844:0:15567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240385664 00000100:00100000:1.0:1788838109.386870:0:15567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240385280 00000100:00100000:1.0:1788838109.386873:0:15567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240385280 00000100:00100000:1.0:1788838109.386885:0:15567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240385792 00000100:00100000:1.0:1788838109.386888:0:15567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240385792 00000100:00100000:1.0:1788838109.386903:0:15567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:1.0:1788838109.386910:0:15567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08402154-aa3b-4815-843a-48a3cef38095+5:2351:x1875732240385408:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788838109.386950:0:15567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08402154-aa3b-4815-843a-48a3cef38095+5:2351:x1875732240385408:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 39us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838109.386957:0:15567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:1.0:1788838109.386970:0:15567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:1.0:1788838109.386976:0:15567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:820a2285-a5f5-467b-86b4-a6c9f6481f5b+5:2351:x1875732240385664:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788838109.387014:0:15567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:820a2285-a5f5-467b-86b4-a6c9f6481f5b+5:2351:x1875732240385664:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 37us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838109.387020:0:15567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:1.0:1788838109.387032:0:15567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:1.0:1788838109.387037:0:15567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08402154-aa3b-4815-843a-48a3cef38095+5:2351:x1875732240385280:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788838109.387060:0:15567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08402154-aa3b-4815-843a-48a3cef38095+5:2351:x1875732240385280:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 23us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838109.387066:0:15567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:1.0:1788838109.387076:0:15567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:1.0:1788838109.387082:0:15567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:820a2285-a5f5-467b-86b4-a6c9f6481f5b+5:2351:x1875732240385792:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788838109.387104:0:15567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:820a2285-a5f5-467b-86b4-a6c9f6481f5b+5:2351:x1875732240385792:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 22us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838109.387109:0:15567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:2.0:1788838109.387645:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240385152 00000100:00100000:2.0:1788838109.387651:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240385152 00000100:00100000:2.0:1788838109.387698:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240385536 00000100:00100000:2.0:1788838109.387701:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240385536 00000100:00100000:2.0:1788838109.387722:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:2.0:1788838109.387729:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08402154-aa3b-4815-843a-48a3cef38095+6:2351:x1875732240385152:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788838109.387766:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08402154-aa3b-4815-843a-48a3cef38095+6:2351:x1875732240385152:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 38us (1469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838109.387783:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:2.0:1788838109.387797:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:2.0:1788838109.387803:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:820a2285-a5f5-467b-86b4-a6c9f6481f5b+6:2351:x1875732240385536:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788838109.387829:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:820a2285-a5f5-467b-86b4-a6c9f6481f5b+6:2351:x1875732240385536:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 27us (1367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838109.387835:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00080000:0.0:1788838109.389083:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788838109.389091:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788838109.389093:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788838109.524554:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838109.526799:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240385920 00000100:00100000:2.0:1788838109.526814:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240385920 00000100:00100000:2.0:1788838109.526913:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:2.0:1788838109.526924:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08402154-aa3b-4815-843a-48a3cef38095+6:14439:x1875732240385920:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788838109.526944:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838109.526968:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e7784 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d468 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.527035:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e778b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.527049:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e778b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.527062:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e778b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.527076:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e7792 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.527082:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e7792 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.527102:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e7792 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.527465:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e7799 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.527474:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e7799 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.527480:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e7799 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838109.527503:0:14341:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788838109.527506:0:14341:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788838109.527543:0:14341:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e7799 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.527554:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e778b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.527561:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e778b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.527567:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e778b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.527573:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4800 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788838109.527578:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e778b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.527586:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e778b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.527606:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a461771f00) 00010000:00010000:2.0:1788838109.527609:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838109.527614:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e778b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.527620:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e778b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.527632:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e7792 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.527638:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e7792 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.527643:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e7792 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.527648:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4e00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788838109.527651:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e7792 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.527657:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e7792 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.528079:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff97a448b3c800) 00010000:00010000:2.0:1788838109.528082:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838109.528086:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e7792 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.528092:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e7792 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.528142:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e7784 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d468 expref: 8 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.528156:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5c00/0x2deb895b363e7799 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d468 expref: 7 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.528163:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97a448b3ce00) 00010000:00010000:2.0:1788838109.528165:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788838109.528167:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5c00, rc 0) 00000100:00100000:2.0:1788838109.528352:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08402154-aa3b-4815-843a-48a3cef38095+7:14439:x1875732240385920:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1428us (3807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838109.528361:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:3.0:1788838109.545024:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788838109.549470:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240386176 00000100:00100000:1.0:1788838109.549487:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240386176 00000100:00100000:1.0:1788838109.549581:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:1.0:1788838109.549592:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08402154-aa3b-4815-843a-48a3cef38095+7:14439:x1875732240386176:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788838109.549613:0:14342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838109.549655:0:14342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3cc00/0x2deb895b363e77a0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d46f expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.549955:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e77a7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.549970:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e77a7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.549983:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e77a7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.550035:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e77ae lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.550043:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e77ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.550049:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e77ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.550595:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e77b5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.550606:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e77b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.550613:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e77b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788838109.550623:0:14342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788838109.551067:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e77a7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.551087:0:14342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e77a7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.551093:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e77a7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.551098:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3d400 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788838109.551103:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e77a7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.551111:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e77a7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.551123:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97a448b3ce00) 00010000:00010000:1.0:1788838109.551126:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838109.551131:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e77a7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.551137:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e77a7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.551784:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e77ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.551793:0:14342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e77ae lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.551799:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e77ae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.551804:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3ce00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788838109.551817:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e77ae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.551825:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e77ae lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.551835:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff97a45487f600) 00010000:00010000:1.0:1788838109.551837:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838109.551841:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e77ae lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.551847:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e77ae lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.553550:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3cc00/0x2deb895b363e77a0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d46f expref: 10 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.553574:0:14342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d200/0x2deb895b363e77b5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d46f expref: 9 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.553583:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a45487f200) 00010000:00010000:1.0:1788838109.553587:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838109.553590:0:14342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3d200, rc 0) 00000100:00100000:1.0:1788838109.557480:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08402154-aa3b-4815-843a-48a3cef38095+9:14439:x1875732240386176:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 7875us (12450us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788838109.557495:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:1.0:1788838109.580057:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838109.580174:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240386304 00000100:00100000:2.0:1788838109.580184:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240386304 00000100:00100000:2.0:1788838109.580274:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:2.0:1788838109.580284:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08402154-aa3b-4815-843a-48a3cef38095+9:14439:x1875732240386304:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788838109.580386:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08402154-aa3b-4815-843a-48a3cef38095+9:14439:x1875732240386304:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 Request processed in 103us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838109.580393:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00010000:00010000:0.0:1788838109.604025:0:16053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838109.622415:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838109.622533:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240386432 00000100:00100000:2.0:1788838109.622543:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240386432 00000100:00100000:2.0:1788838109.622607:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:2.0:1788838109.622618:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08402154-aa3b-4815-843a-48a3cef38095+9:14445:x1875732240386432:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788838109.622640:0:15760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838109.622671:0:15760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e77c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d476 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.622751:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e77ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.622766:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e77ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.622777:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e77ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.622792:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e77d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.622799:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e77d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.622807:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e77d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.623014:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e77ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.623021:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e77ca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.623027:0:15760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e77ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.623033:0:15760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4e00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788838109.623037:0:15760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e77ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.623056:0:15760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e77ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.623068:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a461771f00) 00010000:00010000:2.0:1788838109.623070:0:15760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838109.623075:0:15760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e77ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.623081:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e77ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.623093:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e77d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.623099:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e77d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.623105:0:15760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e77d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.623110:0:15760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4800 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788838109.623113:0:15760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e77d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.623119:0:15760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e77d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.623126:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97a448b3c800) 00010000:00010000:2.0:1788838109.623128:0:15760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838109.623132:0:15760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e77d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.625422:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e77d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.625482:0:15760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e77c3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d476 expref: 10 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.625496:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a461771f00) 00010000:00010000:2.0:1788838109.625499:0:15760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838109.625504:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e77c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d476 expref: 10 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.625513:0:15760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5e00, rc 0) 00000100:00100000:2.0:1788838109.625599:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08402154-aa3b-4815-843a-48a3cef38095+9:14445:x1875732240386432:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 2982us (3198us total) trans 0 rc 301/301 00000100:00100000:2.0:1788838109.625608:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:3.0:1788838109.629272:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838109.629396:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240386560 00000100:00100000:2.0:1788838109.629413:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240386560 00000100:00100000:2.0:1788838109.629484:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:2.0:1788838109.629496:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:08402154-aa3b-4815-843a-48a3cef38095+9:14445:x1875732240386560:12345-192.168.204.54@tcp:700:lfs.0 00000100:00100000:2.0:1788838109.629589:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:08402154-aa3b-4815-843a-48a3cef38095+9:14445:x1875732240386560:12345-192.168.204.54@tcp:700:lfs.0 Request processed in 96us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838109.629597:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:0.0:1788838109.639319:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838109.639440:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240386816 00000100:00100000:2.0:1788838109.639452:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240386816 00000100:00100000:2.0:1788838109.639507:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:2.0:1788838109.639518:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08402154-aa3b-4815-843a-48a3cef38095+9:14445:x1875732240386816:12345-192.168.204.54@tcp:36:lfs.0 00010000:00010000:2.0:1788838109.639605:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838109.639633:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e7706 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d3f1 expref: 9 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.639650:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a461771f00) 00010000:00010000:2.0:1788838109.639666:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788838109.639877:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e77d8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.639891:0:14341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e773e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d453 expref: 5 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.639901:0:14341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e77d8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.639936:0:14341:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e773e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d453 expref: 5 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.639952:0:14341:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e773e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d453 expref: 5 pid: 14342 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838109.639967:0:14341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7e7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14341:1875732255058304:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788838109.640522:0:14341:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a450a270c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838109.644304:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838109.644463:0:14341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7e7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14341:1875732255058304:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788838109.644490:0:14341:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e77d8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838109.645244:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240386944 00000100:00100000:1.0:1788838109.645254:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240386944 00010000:00010000:1.0:1788838109.645298:0:14326:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e773e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d453 expref: 6 pid: 14342 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838109.645354:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:1.0:1788838109.645364:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:820a2285-a5f5-467b-86b4-a6c9f6481f5b+6:2351:x1875732240386944:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788838109.645380:0:14326:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838109.645843:0:14326:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e773e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d453 expref: 6 pid: 14342 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.645859:0:14326:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e773e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d453 expref: 6 pid: 14342 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.645884:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e773e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d453 expref: 6 pid: 14342 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.645902:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a461771f00) 00010000:00010000:1.0:1788838109.645907:0:14326:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e77d8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.645917:0:14326:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e77d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.645924:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e77d8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.645957:0:14326:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838109.646029:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:820a2285-a5f5-467b-86b4-a6c9f6481f5b+5:2351:x1875732240386944:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 666us (1737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838109.646037:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00010000:00010000:2.0:1788838109.646350:0:14341:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e77d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.646369:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e77d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.646393:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e77df lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.646403:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e77df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.646411:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e77df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838109.647653:0:14341:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788838109.647679:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e77d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.647687:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e77d8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.647693:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e77d8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.647699:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5e00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788838109.647704:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e77d8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.647712:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e77d8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.647725:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a461771f00) 00010000:00010000:2.0:1788838109.647728:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838109.647741:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e77d8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.647747:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e77d8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838109.647767:0:14341:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000088982c76 reply state 000000003d09e60e transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e77df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838109.647776:0:14341:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788838109.647867:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08402154-aa3b-4815-843a-48a3cef38095+10:14445:x1875732240386816:12345-192.168.204.54@tcp:36:lfs.0 Request processed in 8349us (8555us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788838109.647876:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00010000:00010000:1.0:1788838109.664508:0:3257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e77df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.664540:0:3257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e77df lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.664547:0:3257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e77df lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.664554:0:3257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4800 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788838109.664559:0:3257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e77df lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.664568:0:3257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e77df lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.664585:0:3257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97a448b3c800) 00010000:00010000:1.0:1788838109.664589:0:3257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838109.664594:0:3257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e77df lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.664600:0:3257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e77df lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838109.793093:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838109.796319:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240387072 00000100:00100000:2.0:1788838109.796343:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240387072 00000100:00100000:2.0:1788838109.796431:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:2.0:1788838109.796444:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46ed22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08402154-aa3b-4815-843a-48a3cef38095+9:14453:x1875732240387072:12345-192.168.204.54@tcp:101:lctl.0 00010000:00010000:2.0:1788838109.796479:0:15760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838109.796511:0:15760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e77e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d47d expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.796673:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e77ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.796803:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e77ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.796817:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e77ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838109.796928:0:15760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788838109.797072:0:15760:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788838109.797132:0:15760:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e77ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.797165:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e77e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d47d expref: 11 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.797190:0:15760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4e00/0x2deb895b363e77ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d47d expref: 10 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.797318:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a448b3cb00) 00010000:00010000:2.0:1788838109.797322:0:15760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788838109.797327:0:15760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4e00, rc 0) 00000100:00100000:2.0:1788838109.797431:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46ed22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08402154-aa3b-4815-843a-48a3cef38095+10:14453:x1875732240387072:12345-192.168.204.54@tcp:101:lctl.0 Request processed in 989us (4356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838109.797441:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:0.0:1788838109.826198:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838109.830168:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240387200 00000100:00100000:2.0:1788838109.830193:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240387200 00000100:00100000:2.0:1788838109.830314:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:2.0:1788838109.830328:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:820a2285-a5f5-467b-86b4-a6c9f6481f5b+5:14454:x1875732240387200:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788838109.830358:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838109.830388:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e77f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d484 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.830487:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e77fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.830507:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e77fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.830550:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e77fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838109.830601:0:14340:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788838109.830605:0:14340:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788838109.830633:0:14340:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e77fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.830687:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e77f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d484 expref: 7 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.830712:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5a00/0x2deb895b363e77fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d484 expref: 6 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.830732:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a448b3cb00) 00010000:00010000:2.0:1788838109.830736:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788838109.830741:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5a00, rc 0) 00000100:00100000:2.0:1788838109.830923:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:820a2285-a5f5-467b-86b4-a6c9f6481f5b+6:14454:x1875732240387200:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 597us (4741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838109.830932:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:0.0:1788838109.838678:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788838109.838803:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240387328 00000100:00100000:1.0:1788838109.838817:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240387328 00000100:00100000:1.0:1788838109.838905:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:1.0:1788838109.838917:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:820a2285-a5f5-467b-86b4-a6c9f6481f5b+6:14454:x1875732240387328:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788838109.838945:0:14342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838109.838974:0:14342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e7802 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d48b expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.839112:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e7809 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.839130:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e7809 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.839145:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e7809 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.839162:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3cc00/0x2deb895b363e7810 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.839170:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3cc00/0x2deb895b363e7810 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.839177:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3cc00/0x2deb895b363e7810 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.844983:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3da00/0x2deb895b363e7817 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.845009:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3da00/0x2deb895b363e7817 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.845021:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3da00/0x2deb895b363e7817 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788838109.845071:0:14342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788838109.845075:0:14342:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788838109.845105:0:14342:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3da00/0x2deb895b363e7817 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.845142:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e7809 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.845150:0:14342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e7809 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.845157:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e7809 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.845164:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3d400 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788838109.845169:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e7809 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.845176:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e7809 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.845189:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a448b3cb00) 00010000:00010000:1.0:1788838109.845192:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838109.845197:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e7809 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.845222:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3d400/0x2deb895b363e7809 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.845240:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3cc00/0x2deb895b363e7810 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.845245:0:14342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3cc00/0x2deb895b363e7810 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.845251:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3cc00/0x2deb895b363e7810 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.845264:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3cc00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788838109.845268:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3cc00/0x2deb895b363e7810 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.845274:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3cc00/0x2deb895b363e7810 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.845282:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97a45487f600) 00010000:00010000:1.0:1788838109.845284:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838109.845287:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3cc00/0x2deb895b363e7810 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.845293:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3cc00/0x2deb895b363e7810 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.845336:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3ce00/0x2deb895b363e7802 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d48b expref: 8 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.845350:0:14342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3da00/0x2deb895b363e7817 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d48b expref: 7 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.845358:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97a45487f900) 00010000:00010000:1.0:1788838109.845360:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788838109.845363:0:14342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d3da00, rc 0) 00000100:00100000:1.0:1788838109.845861:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:820a2285-a5f5-467b-86b4-a6c9f6481f5b+7:14454:x1875732240387328:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 6943us (7207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838109.845870:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:1.0:1788838109.852348:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838109.855763:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240387584 00000100:00100000:2.0:1788838109.855787:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240387584 00000100:00100000:2.0:1788838109.855892:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:2.0:1788838109.855905:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:820a2285-a5f5-467b-86b4-a6c9f6481f5b+7:14454:x1875732240387584:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788838109.855936:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838109.855966:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e781e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d492 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838109.856125:0:14340:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788838109.856360:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e781e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d492 expref: 9 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.856378:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a448b3cb00) 00010000:00010000:2.0:1788838109.856382:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788838109.856388:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e781e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d492 expref: 9 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.856406:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb5e00, rc 0) 00000100:00100000:2.0:1788838109.856514:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:820a2285-a5f5-467b-86b4-a6c9f6481f5b+8:14454:x1875732240387584:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 611us (4177us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788838109.856523:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:0.0:1788838109.866291:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838109.866435:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240387840 00000100:00100000:2.0:1788838109.866449:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240387840 00000100:00100000:2.0:1788838109.866518:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:2.0:1788838109.866530:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:820a2285-a5f5-467b-86b4-a6c9f6481f5b+8:14454:x1875732240387840:12345-192.168.204.54@tcp:36:lfs.0 00010000:00010000:2.0:1788838109.866613:0:15760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838109.866670:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d3da00/0x2deb895b363e7817 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d48b expref: 8 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.866694:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97a45487f900) 00010000:00010000:2.0:1788838109.866709:0:15760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788838109.866741:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e782c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.866782:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e782c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.866793:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e782c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838109.867100:0:15760:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003808a99f reply state 0000000041314830 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e782c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838109.867111:0:15760:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788838109.867121:0:15760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788838109.867279:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:820a2285-a5f5-467b-86b4-a6c9f6481f5b+9:14454:x1875732240387840:12345-192.168.204.54@tcp:36:lfs.0 Request processed in 750us (1002us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788838109.867288:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:3.0:1788838109.870614:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:2.0:1788838109.870709:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e782c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.870729:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e782c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.870738:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e782c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.870746:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb5e00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788838109.870751:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e782c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.870760:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e782c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.870784:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97a448b3cc00) 00010000:00010000:2.0:1788838109.870795:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788838109.870802:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e782c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.870810:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e782c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838109.870920:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240388096 00000100:00100000:0.0:1788838109.870934:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240388096 00000100:00100000:0.0:1788838109.871007:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:0.0:1788838109.871019:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:820a2285-a5f5-467b-86b4-a6c9f6481f5b+8:14454:x1875732240388096:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:0.0:1788838109.872608:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:820a2285-a5f5-467b-86b4-a6c9f6481f5b+9:14454:x1875732240388096:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 1578us (1995us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788838109.872625:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:0.0:1788838109.881361:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838109.885476:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240388352 00000100:00100000:2.0:1788838109.885692:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240388352 00000100:00100000:0.0:1788838109.886415:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:0.0:1788838109.886432:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:820a2285-a5f5-467b-86b4-a6c9f6481f5b+9:14454:x1875732240388352:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788838109.886470:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838109.886503:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790a00/0x2deb895b363e7833 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d499 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.886603:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791200/0x2deb895b363e783a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.886621:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791200/0x2deb895b363e783a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.886637:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791200/0x2deb895b363e783a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.886668:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e7841 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.886677:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e7841 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.886683:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e7841 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838109.886835:0:14341:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788838109.886972:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791200/0x2deb895b363e783a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.888759:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791200/0x2deb895b363e783a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.888785:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791200/0x2deb895b363e783a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.888810:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e791200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788838109.888816:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791200/0x2deb895b363e783a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.888828:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791200/0x2deb895b363e783a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.888851:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a448b3cb00) 00010000:00010000:0.0:1788838109.888854:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838109.888860:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791200/0x2deb895b363e783a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.888867:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791200/0x2deb895b363e783a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.888890:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e7841 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.888897:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e7841 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.888903:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e7841 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.888909:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e791600 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:0.0:1788838109.888912:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e7841 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.888918:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e7841 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.888939:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97a446e2e800) 00010000:00010000:0.0:1788838109.888941:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838109.888945:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e7841 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.888951:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e7841 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.894240:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790a00/0x2deb895b363e7833 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d499 expref: 11 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.894271:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a448b3cb00) 00010000:00010000:0.0:1788838109.894274:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788838109.894281:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790a00/0x2deb895b363e7833 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d499 expref: 11 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.894306:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e790a00, rc 0) 00000100:00100000:0.0:1788838109.894451:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:820a2285-a5f5-467b-86b4-a6c9f6481f5b+10:14454:x1875732240388352:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 8023us (13104us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1788838109.894461:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:1.0:1788838109.903147:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838109.903273:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240388480 00000100:00100000:2.0:1788838109.903293:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240388480 00000100:00100000:2.0:1788838109.903383:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:2.0:1788838109.903397:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:820a2285-a5f5-467b-86b4-a6c9f6481f5b+10:14454:x1875732240388480:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788838109.903437:0:15760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838109.903473:0:15760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e784f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d4a0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.903600:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e7856 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.903619:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e7856 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.903634:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e7856 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838109.903681:0:15760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788838109.903686:0:15760:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788838109.903710:0:15760:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e7856 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.903745:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e784f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4a0 expref: 12 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.903788:0:15760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e7856 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4a0 expref: 11 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.903798:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97a448b3cc00) 00010000:00010000:2.0:1788838109.903802:0:15760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788838109.903807:0:15760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a47bbb4800, rc 0) 00000100:00100000:2.0:1788838109.903888:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:820a2285-a5f5-467b-86b4-a6c9f6481f5b+11:14454:x1875732240388480:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 495us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838109.903896:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:0.0:1788838109.907532:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838109.907627:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240388608 00000100:00100000:2.0:1788838109.907640:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240388608 00000100:00100000:0.0:1788838109.907777:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:0.0:1788838109.907793:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:820a2285-a5f5-467b-86b4-a6c9f6481f5b+11:14454:x1875732240388608:12345-192.168.204.54@tcp:37:lfs.0 00000100:00100000:2.0:1788838109.912483:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:820a2285-a5f5-467b-86b4-a6c9f6481f5b+11:14454:x1875732240388608:12345-192.168.204.54@tcp:37:lfs.0 Request processed in 4677us (4950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838109.912500:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:1.0:1788838109.921086:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838109.921559:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240388864 00000100:00100000:3.0:1788838109.921591:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240388864 00000100:00100000:3.0:1788838109.921678:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:3.0:1788838109.921690:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a344aad050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:820a2285-a5f5-467b-86b4-a6c9f6481f5b+11:14454:x1875732240388864:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1788838109.922296:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a344aad050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:820a2285-a5f5-467b-86b4-a6c9f6481f5b+12:14454:x1875732240388864:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 604us (1224us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788838109.922307:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:0.0:1788838109.994673:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838109.995011:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240388992 00000100:00100000:3.0:1788838109.995025:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240388992 00000100:00100000:3.0:1788838109.995143:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:3.0:1788838109.995156:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47b851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08402154-aa3b-4815-843a-48a3cef38095+10:14460:x1875732240388992:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1788838109.995183:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838109.995358:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e785d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d4a7 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.995450:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b400/0x2deb895b363e7864 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.995469:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b400/0x2deb895b363e7864 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.995485:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b400/0x2deb895b363e7864 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.995503:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e786b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.995511:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e786b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.995518:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e786b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.995668:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e7872 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.995677:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e7872 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.995683:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e7872 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838109.995716:0:14340:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788838109.995720:0:14340:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788838109.995758:0:14340:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e7872 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.995771:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b400/0x2deb895b363e7864 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.995776:0:14340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b400/0x2deb895b363e7864 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.995782:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b400/0x2deb895b363e7864 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.995787:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48b400 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788838109.995791:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b400/0x2deb895b363e7864 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.995797:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b400/0x2deb895b363e7864 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.995809:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a448b3cb00) 00010000:00010000:3.0:1788838109.995817:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838109.995822:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b400/0x2deb895b363e7864 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.995828:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b400/0x2deb895b363e7864 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.995855:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e786b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.995861:0:14340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e786b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.995866:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e786b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.995870:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48ba00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788838109.995872:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e786b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.995876:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e786b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.995882:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97a461771400) 00010000:00010000:3.0:1788838109.995883:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838109.995885:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e786b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.995889:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e786b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.995919:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e785d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4a7 expref: 12 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.995941:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b200/0x2deb895b363e7872 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4a7 expref: 11 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.995948:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97a448b3cc00) 00010000:00010000:3.0:1788838109.995949:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788838109.995951:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48b200, rc 0) 00000100:00100000:2.0:1788838109.996707:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47b851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08402154-aa3b-4815-843a-48a3cef38095+11:14460:x1875732240388992:12345-192.168.204.54@tcp:101:bash.0 Request processed in 1547us (2054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838109.996719:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:0.0:1788838109.999960:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838110.000146:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240389248 00000100:00100000:2.0:1788838110.000162:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240389248 00000100:00100000:2.0:1788838110.000292:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:2.0:1788838110.000305:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08402154-aa3b-4815-843a-48a3cef38095+11:14460:x1875732240389248:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788838110.000337:0:14342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838110.000367:0:14342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e7879 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d4ae expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.000529:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7880 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.000564:0:14342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e7856 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4a0 expref: 11 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.000574:0:14342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7880 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.000622:0:14342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e7856 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4a0 expref: 11 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.000639:0:14342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e7856 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4a0 expref: 11 pid: 15760 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838110.000666:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7e7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14342:1875732255058432:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788838110.000788:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a449686cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838110.004451:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838110.004718:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7e7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14342:1875732255058432:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788838110.004758:0:14342:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7880 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838110.005048:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240389376 00000100:00100000:3.0:1788838110.005058:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240389376 00010000:00010000:3.0:1788838110.005109:0:14325:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e7856 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4a0 expref: 12 pid: 15760 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838110.005235:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:3.0:1788838110.005248:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:820a2285-a5f5-467b-86b4-a6c9f6481f5b+12:2352:x1875732240389376:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788838110.005268:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838110.005276:0:14325:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e7856 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4a0 expref: 12 pid: 15760 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.005291:0:14325:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e7856 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4a0 expref: 12 pid: 15760 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.005320:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4800/0x2deb895b363e7856 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4a0 expref: 12 pid: 15760 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.005341:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97a448b3cc00) 00010000:00010000:3.0:1788838110.005347:0:14325:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7880 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.005370:0:14325:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7880 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.005380:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7880 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.005416:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788838110.005493:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:820a2285-a5f5-467b-86b4-a6c9f6481f5b+11:2352:x1875732240389376:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 247us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838110.005502:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00010000:00010000:2.0:1788838110.005854:0:14342:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7880 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.005864:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7880 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.005912:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31200/0x2deb895b363e7887 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.005924:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31200/0x2deb895b363e7887 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.005938:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31200/0x2deb895b363e7887 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.006847:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31c00/0x2deb895b363e788e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.006862:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31c00/0x2deb895b363e788e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.006872:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31c00/0x2deb895b363e788e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838110.006886:0:14342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788838110.006923:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7880 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.006933:0:14342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7880 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.006941:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7880 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.006948:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a47bbb4400 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788838110.006953:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7880 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.006963:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7880 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.006977:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97a448b3cc00) 00010000:00010000:2.0:1788838110.006981:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838110.006995:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7880 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.007003:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb4400/0x2deb895b363e7880 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838110.007019:0:14342:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b83cc56a reply state 0000000062d69597 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31200/0x2deb895b363e7887 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838110.007028:0:14342:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788838110.007077:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a47bbb5e00/0x2deb895b363e7879 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4ae expref: 14 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.007093:0:14342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31c00/0x2deb895b363e788e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4ae expref: 13 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.007101:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a448b3c500) 00010000:00010000:2.0:1788838110.007104:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788838110.007106:0:14342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d31c00, rc 0) 00000100:00100000:2.0:1788838110.007227:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08402154-aa3b-4815-843a-48a3cef38095+14:14460:x1875732240389248:12345-192.168.204.54@tcp:101:bash.0 Request processed in 6898us (7257us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788838110.007237:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00010000:00010000:1.0:1788838110.010241:0:3257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31200/0x2deb895b363e7887 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838110.010264:0:3257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31200/0x2deb895b363e7887 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838110.010272:0:3257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31200/0x2deb895b363e7887 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838110.010279:0:3257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d31200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788838110.010287:0:3257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31200/0x2deb895b363e7887 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838110.010296:0:3257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31200/0x2deb895b363e7887 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838110.010319:0:3257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff97a448b3c100) 00010000:00010000:1.0:1788838110.010322:0:3257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838110.010329:0:3257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31200/0x2deb895b363e7887 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838110.010336:0:3257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31200/0x2deb895b363e7887 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838110.020859:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788838110.021088:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240389504 00000100:00100000:0.0:1788838110.021102:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240389504 00000100:00100000:0.0:1788838110.021185:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:0.0:1788838110.021252:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08402154-aa3b-4815-843a-48a3cef38095+13:14460:x1875732240389504:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1788838110.021288:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838110.021317:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e789c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d4b5 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838110.021404:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e78a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838110.021421:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e78a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838110.021434:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e78a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838110.021486:0:14341:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788838110.021491:0:14341:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788838110.021519:0:14341:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e78a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838110.021531:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e78a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838110.021560:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791600/0x2deb895b363e789c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4b5 expref: 15 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838110.021581:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e78a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4b5 expref: 14 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838110.021614:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a448b3c500) 00010000:00010000:0.0:1788838110.021618:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788838110.021622:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e791000, rc 0) 00000100:00100000:0.0:1788838110.021710:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08402154-aa3b-4815-843a-48a3cef38095+14:14460:x1875732240389504:12345-192.168.204.54@tcp:101:bash.0 Request processed in 462us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838110.021718:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:0.0:1788838110.024941:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838110.025042:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240389760 00000100:00100000:3.0:1788838110.025056:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240389760 00000100:00100000:3.0:1788838110.025135:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:3.0:1788838110.025149:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08402154-aa3b-4815-843a-48a3cef38095+14:14460:x1875732240389760:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:3.0:1788838110.025704:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08402154-aa3b-4815-843a-48a3cef38095+15:14460:x1875732240389760:12345-192.168.204.54@tcp:35:bash.0 Request processed in 555us (775us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788838110.025712:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:1.0:1788838110.120775:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838110.120944:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240390016 00000100:00100000:3.0:1788838110.120957:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240390016 00000100:00100000:3.0:1788838110.121051:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:3.0:1788838110.121064:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08402154-aa3b-4815-843a-48a3cef38095+15:14470:x1875732240390016:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788838110.121098:0:15760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838110.121127:0:15760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e78aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d4bc expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838110.121327:0:15760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788838110.121483:0:15760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e78aa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4bc expref: 17 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.121509:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a448b3cb00) 00010000:00010000:3.0:1788838110.121512:0:15760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788838110.121519:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e78aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4bc expref: 17 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.121536:0:15760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48be00, rc 0) 00000100:00100000:3.0:1788838110.121606:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08402154-aa3b-4815-843a-48a3cef38095+16:14470:x1875732240390016:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 545us (847us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788838110.121614:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:1.0:1788838110.125510:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838110.125612:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240390272 00000100:00100000:3.0:1788838110.125626:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240390272 00000100:00100000:3.0:1788838110.125709:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:3.0:1788838110.125721:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08402154-aa3b-4815-843a-48a3cef38095+16:14470:x1875732240390272:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1788838110.126447:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08402154-aa3b-4815-843a-48a3cef38095+17:14470:x1875732240390272:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 723us (947us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788838110.126458:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:0.0:1788838110.171343:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838110.171582:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240390528 00000100:00100000:2.0:1788838110.171598:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240390528 00000100:00100000:2.0:1788838110.171685:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:2.0:1788838110.171697:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08402154-aa3b-4815-843a-48a3cef38095+17:14473:x1875732240390528:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788838110.171731:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838110.171760:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30800/0x2deb895b363e78b8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d4c3 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.171951:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30200/0x2deb895b363e78bf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.171969:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30200/0x2deb895b363e78bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.171982:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30200/0x2deb895b363e78bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838110.172006:0:14341:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788838110.172181:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30800/0x2deb895b363e78b8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4c3 expref: 20 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.172264:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30200/0x2deb895b363e78bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4c3 expref: 19 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.172275:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a448b3c500) 00010000:00010000:2.0:1788838110.172279:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788838110.172282:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d30200, rc 0) 00000100:00100000:2.0:1788838110.172360:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08402154-aa3b-4815-843a-48a3cef38095+19:14473:x1875732240390528:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 665us (1033us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788838110.172369:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:1.0:1788838110.177955:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788838110.178076:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838110.178324:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240390656 00000100:00100000:3.0:1788838110.178338:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240390656 00000100:00100000:3.0:1788838110.178415:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:3.0:1788838110.178427:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08402154-aa3b-4815-843a-48a3cef38095+19:14473:x1875732240390656:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:3.0:1788838110.178523:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e78cd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.178545:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e78cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.178570:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e78cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.178605:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e78cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.178613:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e78cd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.178620:0:15760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e78cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.178627:0:15760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48be00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788838110.178632:0:15760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e78cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.178640:0:15760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e78cd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.178662:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a448b3c500) 00010000:00010000:3.0:1788838110.178667:0:15760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788838110.178673:0:15760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e78cd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.178680:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e78cd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838110.178771:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08402154-aa3b-4815-843a-48a3cef38095+19:14473:x1875732240390656:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 346us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838110.178779:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:2.0:1788838110.180261:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240390784 00000100:00100000:2.0:1788838110.180279:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240390784 00000100:00100000:2.0:1788838110.180460:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:2.0:1788838110.180472:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08402154-aa3b-4815-843a-48a3cef38095+19:2352:x1875732240390784:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788838110.180490:0:14326:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838110.180536:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30200/0x2deb895b363e78bf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4c3 expref: 19 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.180558:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a448b3c500) 00010000:00010000:2.0:1788838110.180564:0:14326:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838110.180633:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08402154-aa3b-4815-843a-48a3cef38095+18:2352:x1875732240390784:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 164us (2557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838110.180641:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:1.0:1788838110.184156:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838110.184494:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240391040 00000100:00100000:2.0:1788838110.184508:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240391040 00000100:00100000:2.0:1788838110.184584:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:2.0:1788838110.184595:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08402154-aa3b-4815-843a-48a3cef38095+18:14473:x1875732240391040:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788838110.184949:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08402154-aa3b-4815-843a-48a3cef38095+19:14473:x1875732240391040:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 354us (805us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788838110.184958:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000040:00080000:1.0:1788838110.242962:0:14371:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788838110.490999:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838110.491130:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240391296 00000100:00100000:2.0:1788838110.491144:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240391296 00000100:00100000:2.0:1788838110.491286:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:2.0:1788838110.491299:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08402154-aa3b-4815-843a-48a3cef38095+19:14505:x1875732240391296:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:2.0:1788838110.491330:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838110.491358:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30200/0x2deb895b363e78d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d4ca expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.491504:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30800/0x2deb895b363e78db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.491522:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30800/0x2deb895b363e78db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.491555:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30800/0x2deb895b363e78db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838110.491569:0:14341:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788838110.491779:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30200/0x2deb895b363e78d4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4ca expref: 22 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.491801:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30800/0x2deb895b363e78db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4ca expref: 21 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.491812:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a448b3c500) 00010000:00010000:2.0:1788838110.491815:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788838110.491819:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d30800, rc 0) 00000100:00100000:2.0:1788838110.491904:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08402154-aa3b-4815-843a-48a3cef38095+21:14505:x1875732240391296:12345-192.168.204.54@tcp:101:cat.0 Request processed in 608us (920us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788838110.491912:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:0.0:1788838110.498068:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788838110.498129:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838110.498377:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240391552 00000100:00100000:2.0:1788838110.498392:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240391552 00000100:00100000:2.0:1788838110.498480:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:2.0:1788838110.498492:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08402154-aa3b-4815-843a-48a3cef38095+21:14505:x1875732240391552:12345-192.168.204.54@tcp:35:cat.0 00000100:00100000:2.0:1788838110.498987:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08402154-aa3b-4815-843a-48a3cef38095+22:14505:x1875732240391552:12345-192.168.204.54@tcp:35:cat.0 Request processed in 494us (931us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788838110.498997:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:3.0:1788838110.500312:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240391680 00000100:00100000:3.0:1788838110.500328:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240391680 00000100:00100000:3.0:1788838110.500529:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:3.0:1788838110.500544:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08402154-aa3b-4815-843a-48a3cef38095+22:2352:x1875732240391680:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788838110.500565:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838110.500603:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30800/0x2deb895b363e78db lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4ca expref: 22 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.500631:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a448b3c500) 00010000:00010000:3.0:1788838110.500638:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788838110.500723:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08402154-aa3b-4815-843a-48a3cef38095+21:2352:x1875732240391680:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 182us (2592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838110.500733:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:0.0:1788838110.571999:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838110.572172:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240391936 00000100:00100000:3.0:1788838110.572242:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240391936 00000100:00100000:3.0:1788838110.572317:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:3.0:1788838110.572328:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08402154-aa3b-4815-843a-48a3cef38095+21:14511:x1875732240391936:12345-192.168.204.54@tcp:101:dd.0 00010000:00010000:3.0:1788838110.572363:0:15760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838110.572393:0:15760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e78e9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d4d1 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.572544:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e78f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.572563:0:15760:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31c00/0x2deb895b363e788e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4ae expref: 22 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.572572:0:15760:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e78a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4b5 expref: 22 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.572599:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e78f0 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.572658:0:15760:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e78a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4b5 expref: 22 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.572674:0:15760:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e78a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4b5 expref: 22 pid: 14341 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838110.572690:0:15760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a45108c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15760:1875732255058560:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788838110.572830:0:15760:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31c00/0x2deb895b363e788e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4ae expref: 22 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.572841:0:15760:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31c00/0x2deb895b363e788e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4ae expref: 22 pid: 14342 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838110.572849:0:15760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a45108f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15760:1875732255058688:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788838110.572876:0:15760:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4601b4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788838110.576500:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838110.576687:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240392064 00000100:00100000:2.0:1788838110.576701:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240392064 00010000:00010000:2.0:1788838110.576763:0:14326:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e78a3 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4b5 expref: 23 pid: 14341 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838110.576846:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:2.0:1788838110.576858:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47baea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08402154-aa3b-4815-843a-48a3cef38095+23:2352:x1875732240392064:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788838110.576877:0:14326:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838110.576885:0:14326:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e78a3 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4b5 expref: 23 pid: 14341 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.576901:0:14326:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e78a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4b5 expref: 23 pid: 14341 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.576931:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a448b3c500) 00010000:00010000:2.0:1788838110.576938:0:14326:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e78f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.576947:0:14326:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e78f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.576953:0:14326:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838110.577036:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47baea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08402154-aa3b-4815-843a-48a3cef38095+23:2352:x1875732240392064:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 178us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838110.577044:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00010000:00010000:3.0:1788838110.577759:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791000/0x2deb895b363e78a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4b5 expref: 22 pid: 14341 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838110.577782:0:15760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a45108c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15760:1875732255058560:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788838110.577794:0:15760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a45108f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15760:1875732255058688:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788838110.577835:0:15760:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e78f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838110.580450:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788838110.580614:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240392192 00000100:00100000:0.0:1788838110.580629:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240392192 00010000:00010000:0.0:1788838110.580692:0:14327:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31c00/0x2deb895b363e788e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4ae expref: 22 pid: 14342 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838110.580746:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:0.0:1788838110.580757:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08402154-aa3b-4815-843a-48a3cef38095+22:2351:x1875732240392192:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788838110.580778:0:14327:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838110.580786:0:14327:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31c00/0x2deb895b363e788e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4ae expref: 22 pid: 14342 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838110.580801:0:14327:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31c00/0x2deb895b363e788e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4ae expref: 22 pid: 14342 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838110.580838:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31c00/0x2deb895b363e788e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4ae expref: 22 pid: 14342 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838110.580878:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a448b3c500) 00010000:00010000:0.0:1788838110.580884:0:14327:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e78f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838110.580895:0:14327:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e78f0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838110.580903:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e78f0 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838110.580941:0:14327:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838110.581022:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08402154-aa3b-4815-843a-48a3cef38095+21:2351:x1875732240392192:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 266us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838110.581030:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00010000:00010000:3.0:1788838110.581146:0:15760:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e78f0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.581155:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e78f0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838110.581178:0:15760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788838110.581463:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e78e9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4d1 expref: 22 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.581482:0:15760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48ba00/0x2deb895b363e78f0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4d1 expref: 21 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.581489:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a448b3c500) 00010000:00010000:3.0:1788838110.581493:0:15760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788838110.581495:0:15760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48ba00, rc 0) 00000100:00100000:3.0:1788838110.581529:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08402154-aa3b-4815-843a-48a3cef38095+21:14511:x1875732240391936:12345-192.168.204.54@tcp:101:dd.0 Request processed in 9203us (9547us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1788838110.581537:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:0.0:1788838110.586255:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838110.586406:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240392448 00000100:00100000:2.0:1788838110.586431:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240392448 00000100:00100000:2.0:1788838110.586514:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:2.0:1788838110.586526:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08402154-aa3b-4815-843a-48a3cef38095+21:14511:x1875732240392448:12345-192.168.204.54@tcp:36:dd.0 00010000:00010000:2.0:1788838110.586933:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30200/0x2deb895b363e78fe lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.586978:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30200/0x2deb895b363e78fe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.586992:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30200/0x2deb895b363e78fe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788838110.587055:0:14341:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788838110.587101:0:14341:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001dc7ef98 reply state 00000000e94f3a38 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30200/0x2deb895b363e78fe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838110.587112:0:14341:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788838110.587279:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08402154-aa3b-4815-843a-48a3cef38095+24:14511:x1875732240392448:12345-192.168.204.54@tcp:36:dd.0 Request processed in 754us (1097us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788838110.587287:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 35 00000020:00080000:2.0:1788838110.587293:0:14341:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788838110.590604:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30200/0x2deb895b363e78fe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.590654:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30200/0x2deb895b363e78fe lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.590662:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30200/0x2deb895b363e78fe lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.590669:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d30200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788838110.590675:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30200/0x2deb895b363e78fe lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.590685:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30200/0x2deb895b363e78fe lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.590781:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a448b3c500) 00010000:00010000:2.0:1788838110.590785:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838110.590792:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30200/0x2deb895b363e78fe lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.590799:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30200/0x2deb895b363e78fe lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838110.593402:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838110.593716:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240392576 00000100:00100000:2.0:1788838110.593730:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240392576 00000100:00100000:2.0:1788838110.593798:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:2.0:1788838110.593810:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08402154-aa3b-4815-843a-48a3cef38095+23:14511:x1875732240392576:12345-192.168.204.54@tcp:101:dd.0 00010000:00010000:2.0:1788838110.593857:0:14342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838110.593892:0:14342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31e00/0x2deb895b363e7905 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d4d8 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.594074:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31e00/0x2deb895b363e7905 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4d8 expref: 24 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.594093:0:14342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31e00/0x2deb895b363e7905 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4d8 expref: 24 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.594144:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a448b3c500) 00010000:00010000:2.0:1788838110.594148:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788838110.594152:0:14342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d31e00, rc 0) 00000100:00100000:2.0:1788838110.594941:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08402154-aa3b-4815-843a-48a3cef38095+24:14511:x1875732240392576:12345-192.168.204.54@tcp:101:dd.0 Request processed in 1127us (1548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838110.594952:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:1.0:1788838110.614121:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838110.614232:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240392832 00000100:00100000:3.0:1788838110.614246:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240392832 00000100:00100000:3.0:1788838110.614338:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:3.0:1788838110.614352:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08402154-aa3b-4815-843a-48a3cef38095+24:14511:x1875732240392832:12345-192.168.204.54@tcp:103:dd.0 00010000:00010000:3.0:1788838110.614377:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838110.614411:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31e00/0x2deb895b363e7905 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4d8 expref: 24 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.614469:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a448b3c500) 00010000:00010000:3.0:1788838110.614475:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788838110.614559:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08402154-aa3b-4815-843a-48a3cef38095+23:14511:x1875732240392832:12345-192.168.204.54@tcp:103:dd.0 Request processed in 210us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838110.614569:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:1.0:1788838110.617114:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838110.617251:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240392960 00000100:00100000:2.0:1788838110.617264:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240392960 00000100:00100000:2.0:1788838110.617340:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:2.0:1788838110.617351:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08402154-aa3b-4815-843a-48a3cef38095+23:14511:x1875732240392960:12345-192.168.204.54@tcp:58:dd.0 00010000:00010000:2.0:1788838110.617620:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30200/0x2deb895b363e790c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.617653:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30200/0x2deb895b363e790c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838110.617667:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30200/0x2deb895b363e790c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788838110.619958:0:14341:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788838110.620160:0:14341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788838110.620568:0:14341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788838110.620817:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08402154-aa3b-4815-843a-48a3cef38095+23:14511:x1875732240392960:12345-192.168.204.54@tcp:58:dd.0 Request processed in 3459us (3710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838110.620840:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:1.0:1788838110.623891:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838110.624031:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240393088 00000100:00100000:3.0:1788838110.624045:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240393088 00000100:00100000:3.0:1788838110.624125:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:3.0:1788838110.624137:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08402154-aa3b-4815-843a-48a3cef38095+23:14511:x1875732240393088:12345-192.168.204.54@tcp:101:dd.0 00010000:00010000:3.0:1788838110.624165:0:15760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838110.624194:0:15760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e7913 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d4df expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.624310:0:15760:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30200/0x2deb895b363e790c lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.624324:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e7913 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4df expref: 24 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.624350:0:15760:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30200/0x2deb895b363e790c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.624366:0:15760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e7913 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4df expref: 24 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.624385:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a448b3c500) 00010000:00010000:3.0:1788838110.624407:0:15760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788838110.624413:0:15760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e7913 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4df expref: 24 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838110.624495:0:15760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a44a48be00, rc 0) 00000100:00100000:3.0:1788838110.624581:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08402154-aa3b-4815-843a-48a3cef38095+24:14511:x1875732240393088:12345-192.168.204.54@tcp:101:dd.0 Request processed in 445us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838110.624589:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 38 00010000:00010000:0.0:1788838110.626506:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788838111.269312:0:14371:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788838111.269324:0:14371:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788838111.269370:0:14371:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788838111.269379:0:14371:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788838111.269553:0:14371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a47fc55180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14371:1875732255058816:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788838111.269726:0:14371:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4673f9480 going to sleep for 11 seconds 00000100:00100000:0.0:1788838111.282750:0:14371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a47fc55180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14371:1875732255058816:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788838111.284654:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838111.285498:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240393216 00000100:00100000:3.0:1788838111.285514:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240393216 00000100:00100000:3.0:1788838111.285633:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:3.0:1788838111.285649:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a47fc55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:08402154-aa3b-4815-843a-48a3cef38095+24:14512:x1875732240393216:12345-192.168.204.54@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788838111.285764:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a47fc55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:08402154-aa3b-4815-843a-48a3cef38095+24:14512:x1875732240393216:12345-192.168.204.54@tcp:900:lhsmtool_posix.0 Request processed in 120us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838111.285773:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00080000:0.0:1788838111.286525:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788838111.288501:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838111.288617:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240393344 00000100:00100000:2.0:1788838111.288641:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240393344 00000100:00100000:2.0:1788838111.288713:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:2.0:1788838111.288723:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08402154-aa3b-4815-843a-48a3cef38095+24:14512:x1875732240393344:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788838111.288765:0:14340:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788838111.288903:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08402154-aa3b-4815-843a-48a3cef38095+24:14512:x1875732240393344:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 180us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838111.288911:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:1.0:1788838111.296466:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838111.296588:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240393472 00000100:00100000:3.0:1788838111.296603:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240393472 00000100:00100000:3.0:1788838111.296736:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:3.0:1788838111.296749:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08402154-aa3b-4815-843a-48a3cef38095+24:14512:x1875732240393472:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788838111.296848:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b400/0x2deb895b363e791a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.296869:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b400/0x2deb895b363e791a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.296883:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b400/0x2deb895b363e791a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.310398:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31a00/0x2deb895b363e7921 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.310447:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31a00/0x2deb895b363e7921 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.310469:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31a00/0x2deb895b363e7921 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.310512:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30c00/0x2deb895b363e7928 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.310520:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30c00/0x2deb895b363e7928 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.310526:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30c00/0x2deb895b363e7928 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838111.310580:0:15760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788838111.310585:0:15760:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788838111.310598:0:15760:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30c00/0x2deb895b363e7928 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.310611:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b400/0x2deb895b363e791a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.310617:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b400/0x2deb895b363e791a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.310635:0:15760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b400/0x2deb895b363e791a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.310641:0:15760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48b400 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788838111.310645:0:15760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b400/0x2deb895b363e791a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.310659:0:15760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b400/0x2deb895b363e791a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.310672:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a45487f200) 00010000:00010000:2.0:1788838111.310675:0:15760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838111.310680:0:15760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b400/0x2deb895b363e791a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.310686:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48b400/0x2deb895b363e791a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.310703:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31a00/0x2deb895b363e7921 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.310709:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31a00/0x2deb895b363e7921 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.310715:0:15760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31a00/0x2deb895b363e7921 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.310721:0:15760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d31a00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788838111.310723:0:15760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31a00/0x2deb895b363e7921 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.310730:0:15760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31a00/0x2deb895b363e7921 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.310738:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff97a448b3ca00) 00010000:00010000:2.0:1788838111.310741:0:15760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838111.310744:0:15760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31a00/0x2deb895b363e7921 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.310758:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31a00/0x2deb895b363e7921 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.310775:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30c00/0x2deb895b363e7928 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.310781:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30c00/0x2deb895b363e7928 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.310787:0:15760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30c00/0x2deb895b363e7928 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.310792:0:15760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d30c00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788838111.310795:0:15760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30c00/0x2deb895b363e7928 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.310801:0:15760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30c00/0x2deb895b363e7928 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.310808:0:15760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a448b3c500) 00010000:00010000:2.0:1788838111.310810:0:15760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838111.310813:0:15760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30c00/0x2deb895b363e7928 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.310818:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30c00/0x2deb895b363e7928 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838111.311755:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08402154-aa3b-4815-843a-48a3cef38095+24:14512:x1875732240393472:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 Request processed in 15002us (15297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838111.311767:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:1.0:1788838111.320439:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838111.322662:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240393728 00000100:00100000:2.0:1788838111.322685:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240393728 00000100:00100000:2.0:1788838111.322783:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:2.0:1788838111.322796:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08402154-aa3b-4815-843a-48a3cef38095+24:14512:x1875732240393728:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788838111.323558:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838111.323597:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30c00/0x2deb895b363e792f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d4e6 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.323759:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31a00/0x2deb895b363e7936 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.323778:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31a00/0x2deb895b363e7936 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.323792:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31a00/0x2deb895b363e7936 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838111.324100:0:14340:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788838111.324304:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31a00/0x2deb895b363e7936 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.324314:0:14340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31a00/0x2deb895b363e7936 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.324321:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31a00/0x2deb895b363e7936 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.324329:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d31a00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788838111.324337:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31a00/0x2deb895b363e7936 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.324346:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31a00/0x2deb895b363e7936 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.324392:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a448b3c500) 00010000:00010000:2.0:1788838111.324395:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788838111.324401:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31a00/0x2deb895b363e7936 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.325020:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31a00/0x2deb895b363e7936 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.325099:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30c00/0x2deb895b363e792f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4e6 expref: 26 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.325113:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a45487f200) 00010000:00010000:2.0:1788838111.325116:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788838111.325120:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30c00/0x2deb895b363e792f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4e6 expref: 26 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.325132:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d30c00, rc 0) 00000100:00100000:2.0:1788838111.325306:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08402154-aa3b-4815-843a-48a3cef38095+25:14512:x1875732240393728:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 2511us (4883us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1788838111.325318:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:0.0:1788838111.330930:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838111.331077:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240393856 00000100:00100000:2.0:1788838111.331090:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240393856 00000100:00100000:2.0:1788838111.331175:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:2.0:1788838111.331188:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08402154-aa3b-4815-843a-48a3cef38095+25:14512:x1875732240393856:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788838111.331323:0:14342:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788838111.331476:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08402154-aa3b-4815-843a-48a3cef38095+25:14512:x1875732240393856:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 289us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838111.331494:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:3.0:1788838111.336164:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788838111.336904:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240394112 00000100:00100000:0.0:1788838111.336921:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240394112 00000100:00100000:0.0:1788838111.337019:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:0.0:1788838111.337031:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08402154-aa3b-4815-843a-48a3cef38095+25:14512:x1875732240394112:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788838111.337060:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838111.337090:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790c00/0x2deb895b363e7944 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d4ed expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788838111.338986:0:14341:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:0.0:1788838111.338999:0:14341:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1788838111.339067:0:14341:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1788838111.344858:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790e00/0x2deb895b363e794b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.344889:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790e00/0x2deb895b363e794b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.344905:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790e00/0x2deb895b363e794b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.345260:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790c00/0x2deb895b363e7944 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4ed expref: 28 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.345286:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790e00/0x2deb895b363e794b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4ed expref: 27 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.345296:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97a446e2e800) 00010000:00010000:0.0:1788838111.345300:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788838111.345304:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e790e00, rc 0) 00000100:00100000:0.0:1788838111.345389:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08402154-aa3b-4815-843a-48a3cef38095+27:14512:x1875732240394112:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 8360us (9241us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1788838111.345398:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:1.0:1788838111.355028:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838111.355443:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240394368 00000100:00100000:2.0:1788838111.355458:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240394368 00000100:00100000:2.0:1788838111.355543:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:2.0:1788838111.355555:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08402154-aa3b-4815-843a-48a3cef38095+27:14512:x1875732240394368:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788838111.355657:0:14342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838111.355695:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790e00/0x2deb895b363e794b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4ed expref: 27 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.355721:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97a446e2e800) 00010000:00010000:2.0:1788838111.355736:0:14342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788838111.355767:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30c00/0x2deb895b363e7959 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.355785:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30c00/0x2deb895b363e7959 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.355797:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30c00/0x2deb895b363e7959 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.355827:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31a00/0x2deb895b363e7960 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xfb66a8de bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.355834:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31a00/0x2deb895b363e7960 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfb66a8de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.355842:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31a00/0x2deb895b363e7960 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfb66a8de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.356372:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30c00/0x2deb895b363e7959 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.356384:0:14342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30c00/0x2deb895b363e7959 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.356391:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30c00/0x2deb895b363e7959 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.356398:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d30c00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788838111.356461:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30c00/0x2deb895b363e7959 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.356472:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30c00/0x2deb895b363e7959 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.356483:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97a448b3cc00) 00010000:00010000:2.0:1788838111.356486:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838111.356492:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30c00/0x2deb895b363e7959 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.356498:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30c00/0x2deb895b363e7959 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.356511:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31a00/0x2deb895b363e7960 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfb66a8de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.356518:0:14342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31a00/0x2deb895b363e7960 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfb66a8de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.356524:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31a00/0x2deb895b363e7960 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfb66a8de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.356538:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d31a00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788838111.356542:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31a00/0x2deb895b363e7960 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfb66a8de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.356548:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31a00/0x2deb895b363e7960 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfb66a8de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.356557:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xfb66a8de (ffff97a448b3ca00) 00010000:00010000:2.0:1788838111.356559:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838111.356562:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31a00/0x2deb895b363e7960 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xfb66a8de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.356569:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31a00/0x2deb895b363e7960 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xfb66a8de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838111.356692:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08402154-aa3b-4815-843a-48a3cef38095+26:14512:x1875732240394368:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 1136us (1679us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788838111.356702:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:3.0:1788838111.360291:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838111.360708:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240394496 00000100:00100000:2.0:1788838111.360722:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240394496 00000100:00100000:2.0:1788838111.360800:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:2.0:1788838111.360822:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08402154-aa3b-4815-843a-48a3cef38095+26:14512:x1875732240394496:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788838111.360851:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838111.360886:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30000/0x2deb895b363e7967 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d4f4 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.360934:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31000/0x2deb895b363e796e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.361168:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31000/0x2deb895b363e796e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.361181:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31000/0x2deb895b363e796e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.361386:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30000/0x2deb895b363e7967 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4f4 expref: 28 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.362077:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31000/0x2deb895b363e796e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4f4 expref: 27 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.362092:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97a448b3c200) 00010000:00010000:2.0:1788838111.362095:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788838111.362101:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d31000, rc 0) 00000100:00100000:2.0:1788838111.362291:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08402154-aa3b-4815-843a-48a3cef38095+27:14512:x1875732240394496:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1480us (2017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838111.362301:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:1.0:1788838111.375490:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788838111.375610:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240394752 00000100:00100000:0.0:1788838111.375635:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240394752 00000100:00100000:0.0:1788838111.375717:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:0.0:1788838111.375730:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08402154-aa3b-4815-843a-48a3cef38095+27:14512:x1875732240394752:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788838111.375886:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790c00/0x2deb895b363e7975 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.375909:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790c00/0x2deb895b363e7975 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.375926:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790c00/0x2deb895b363e7975 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788838111.376711:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1788838111.376728:0:15760:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 491470524123ns, next at 492470520853ns, rc = 0 00000004:00010000:0.0:1788838111.376862:0:15760:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3583c85 reply state 0000000068ff16da transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790c00/0x2deb895b363e7975 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838111.376874:0:15760:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788838111.377716:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08402154-aa3b-4815-843a-48a3cef38095+29:14512:x1875732240394752:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 1980us (2235us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788838111.377729:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 46 00010000:00010000:3.0:1788838111.385671:0:3257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790c00/0x2deb895b363e7975 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.385694:0:3257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790c00/0x2deb895b363e7975 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.385703:0:3257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790c00/0x2deb895b363e7975 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.385710:0:3257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e790c00 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:3.0:1788838111.385715:0:3257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790c00/0x2deb895b363e7975 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.385724:0:3257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790c00/0x2deb895b363e7975 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.385748:0:3257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97a448b3c200) 00010000:00010000:3.0:1788838111.385752:0:3257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788838111.385757:0:3257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790c00/0x2deb895b363e7975 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.385764:0:3257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790c00/0x2deb895b363e7975 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838111.393483:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788838111.393855:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240394880 00000100:00100000:0.0:1788838111.393867:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240394880 00000100:00100000:0.0:1788838111.393963:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:0.0:1788838111.393975:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08402154-aa3b-4815-843a-48a3cef38095+28:14512:x1875732240394880:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788838111.394010:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838111.394040:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790a00/0x2deb895b363e797c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d4fb expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.394120:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790a00/0x2deb895b363e797c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4fb expref: 29 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.394164:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790a00/0x2deb895b363e797c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4fb expref: 29 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.394192:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97a448b3c200) 00010000:00010000:0.0:1788838111.394196:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788838111.394252:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e790a00, rc 0) 00000100:00100000:0.0:1788838111.394332:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08402154-aa3b-4815-843a-48a3cef38095+29:14512:x1875732240394880:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 360us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838111.394340:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:1.0:1788838111.399892:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788838111.400269:0:15567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240395008 00000100:00100000:0.0:1788838111.400283:0:15567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240395008 00000100:00100000:0.0:1788838111.400385:0:15567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:0.0:1788838111.400399:0:15567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08402154-aa3b-4815-843a-48a3cef38095+5:2351:x1875732240395008:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788838111.400918:0:15567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08402154-aa3b-4815-843a-48a3cef38095+6:2351:x1875732240395008:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 520us (1040us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788838111.400927:0:15567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00080000:3.0:1788838111.403245:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788838111.411711:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838111.411824:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240395264 00000100:00100000:2.0:1788838111.411838:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240395264 00000100:00100000:2.0:1788838111.411944:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:2.0:1788838111.412823:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08402154-aa3b-4815-843a-48a3cef38095+29:14512:x1875732240395264:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788838111.413424:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08402154-aa3b-4815-843a-48a3cef38095+30:14512:x1875732240395264:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 621us (1724us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1788838111.413434:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:1.0:1788838111.416887:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838111.418374:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240395520 00000100:00100000:3.0:1788838111.418394:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240395520 00000100:00100000:3.0:1788838111.418501:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:3.0:1788838111.418513:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08402154-aa3b-4815-843a-48a3cef38095+30:14512:x1875732240395520:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788838111.418718:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08402154-aa3b-4815-843a-48a3cef38095+30:14512:x1875732240395520:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 206us (1846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838111.418726:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:3.0:1788838111.421611:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788838111.421730:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240395648 00000100:00100000:0.0:1788838111.421745:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240395648 00000100:00100000:0.0:1788838111.421836:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:0.0:1788838111.421848:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08402154-aa3b-4815-843a-48a3cef38095+30:14512:x1875732240395648:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788838111.421880:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838111.421910:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791200/0x2deb895b363e7983 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d502 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.422380:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790c00/0x2deb895b363e798a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.422408:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790c00/0x2deb895b363e798a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.422422:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790c00/0x2deb895b363e798a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838111.422473:0:14341:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788838111.422498:0:14341:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790c00/0x2deb895b363e798a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.422531:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e791200/0x2deb895b363e7983 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d502 expref: 32 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.422554:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790c00/0x2deb895b363e798a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d502 expref: 31 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.422564:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97a448b3c200) 00010000:00010000:0.0:1788838111.422568:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788838111.422572:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a46e790c00, rc 0) 00000100:00100000:0.0:1788838111.422663:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08402154-aa3b-4815-843a-48a3cef38095+31:14512:x1875732240395648:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 817us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838111.422672:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:3.0:1788838111.427362:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838111.437023:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240395776 00000100:00100000:2.0:1788838111.437073:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240395776 00000100:00100000:2.0:1788838111.437504:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:2.0:1788838111.437518:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:08402154-aa3b-4815-843a-48a3cef38095+6:2352:x1875732240395776:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788838111.437544:0:15029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838111.437572:0:15029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000886ed532/0x2deb895b363e7991 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3a436432fd0d509 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788838111.437607:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f80de, blocks: 0x1 00010000:00010000:2.0:1788838111.437643:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=491s v=(0 0) 00010000:00010000:2.0:1788838111.437649:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838111.437660:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000886ed532/0x2deb895b363e7991 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d509 expref: 7 pid: 15029 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.437683:0:15029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000886ed532/0x2deb895b363e7991 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d509 expref: 7 pid: 15029 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.437700:0:15029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a458d30000, rc 0) 00000100:00100000:2.0:1788838111.437831:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:08402154-aa3b-4815-843a-48a3cef38095+7:2352:x1875732240395776:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 316us (10482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838111.437838:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:1.0:1788838111.453452:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838111.454962:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240396032 00000100:00100000:3.0:1788838111.454980:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240396032 00000100:00100000:3.0:1788838111.455071:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:3.0:1788838111.455084:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08402154-aa3b-4815-843a-48a3cef38095+31:14512:x1875732240396032:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788838111.455292:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08402154-aa3b-4815-843a-48a3cef38095+31:14512:x1875732240396032:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 210us (1854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838111.455300:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:0.0:1788838111.459168:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788838111.459326:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240396160 00000100:00100000:1.0:1788838111.459339:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240396160 00000100:00100000:1.0:1788838111.459413:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:1.0:1788838111.459426:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08402154-aa3b-4815-843a-48a3cef38095+31:14512:x1875732240396160:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788838111.520322:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:2.0:1788838111.520343:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788838111.520375:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:2.0:1788838111.520388:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:2.0:1788838111.520441:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1788838111.520666:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788838111.520694:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a45108c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255058944:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788838111.520787:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838111.521071:0:15567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255058944 00000100:00100000:3.0:1788838111.521082:0:15567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255058944 00000100:00100000:3.0:1788838111.521154:0:15567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788838111.521165:0:15567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3274:x1875732255058944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788838111.521398:0:15567:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788838111.521403:0:15567:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788838111.521405:0:15567:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788838111.521407:0:15567:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788838110 -> 1788838110 00002000:00010000:3.0:1788838111.521410:0:15567:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788838111.521463:0:15567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3274:x1875732255058944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 298us (675us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788838111.521490:0:15567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1788838111.521552:0:3274:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97a45108c700/2, rc 0, transno 8589934595 00000100:00100000:3.0:1788838111.521559:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a45108c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3274:1875732255058944:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1788838111.521618:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788838111.524472:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838111.524596:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240396288 00000100:00100000:2.0:1788838111.524636:0:15027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240396288 00000100:00100000:2.0:1788838111.524706:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:2.0:1788838111.524718:0:15027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08402154-aa3b-4815-843a-48a3cef38095+7:2351:x1875732240396288:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788838111.524873:0:15027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08402154-aa3b-4815-843a-48a3cef38095+7:2351:x1875732240396288:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 Request processed in 157us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838111.524881:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:0.0:1788838111.525075:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08402154-aa3b-4815-843a-48a3cef38095+14:14512:x1875732240396160:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 Request processed in 62379us (62651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838111.525087:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:2.0:1788838111.527513:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838111.527630:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240396544 00000100:00100000:3.0:1788838111.527643:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240396544 00000100:00100000:3.0:1788838111.527720:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:3.0:1788838111.527731:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08402154-aa3b-4815-843a-48a3cef38095+14:14512:x1875732240396544:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788838111.527806:0:14342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838111.527844:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790c00/0x2deb895b363e798a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d502 expref: 14 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.527880:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97a448b3c200) 00010000:00010000:3.0:1788838111.527886:0:14342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788838111.527925:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a800/0x2deb895b363e7998 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.527941:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a800/0x2deb895b363e7998 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.528136:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a800/0x2deb895b363e7998 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788838111.528739:0:14342:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af7e807f reply state 00000000df7ff9e8 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a800/0x2deb895b363e7998 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838111.528752:0:14342:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788838111.528918:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08402154-aa3b-4815-843a-48a3cef38095+15:14512:x1875732240396544:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 1185us (1415us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788838111.528948:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:0.0:1788838111.531945:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838111.532090:0:15567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240396672 00000100:00100000:3.0:1788838111.532103:0:15567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240396672 00000100:00100000:3.0:1788838111.532176:0:15567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:3.0:1788838111.532188:0:15567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46f4d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08402154-aa3b-4815-843a-48a3cef38095+7:2352:x1875732240396672:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788838111.532489:0:15567:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788838111.532493:0:15567:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788838109 00002000:00010000:3.0:1788838111.532496:0:15567:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788838109 00002000:00010000:3.0:1788838111.532498:0:15567:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788838110 -> 1788838109 00002000:00010000:3.0:1788838111.532500:0:15567:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788838111.532579:0:15567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46f4d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08402154-aa3b-4815-843a-48a3cef38095+8:2352:x1875732240396672:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 393us (648us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788838111.532588:0:15567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00010000:00010000:1.0:1788838111.532922:0:3258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a800/0x2deb895b363e7998 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.532932:0:3258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a800/0x2deb895b363e7998 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.532940:0:3258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a800/0x2deb895b363e7998 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.532946:0:3258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48a800 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:1.0:1788838111.532962:0:3258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a800/0x2deb895b363e7998 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.532971:0:3258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a800/0x2deb895b363e7998 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.532993:0:3258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97a448b3c200) 00010000:00010000:1.0:1788838111.532997:0:3258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838111.533003:0:3258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a800/0x2deb895b363e7998 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.533010:0:3258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a800/0x2deb895b363e7998 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838111.535568:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838111.535651:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240396800 00000100:00100000:3.0:1788838111.535663:0:15027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240396800 00000100:00100000:3.0:1788838111.535775:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:3.0:1788838111.535787:0:15027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08402154-aa3b-4815-843a-48a3cef38095+8:2352:x1875732240396800:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788838111.535856:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006643167d/0x2deb895b363e799f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.535877:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838111.535882:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838111.535889:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006643167d/0x2deb895b363e799f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.535907:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006643167d/0x2deb895b363e799f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.535974:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006643167d/0x2deb895b363e799f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.535984:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006643167d/0x2deb895b363e799f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.535993:0:15027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006643167d/0x2deb895b363e799f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.536001:0:15027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48b400 already unused, calling callback (ffffffffc1616420) 00010000:00010000:3.0:1788838111.536005:0:15027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006643167d/0x2deb895b363e799f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.536016:0:15027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006643167d/0x2deb895b363e799f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.536037:0:15027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006643167d/0x2deb895b363e799f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.536045:0:15027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006643167d/0x2deb895b363e799f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838111.536144:0:15027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08402154-aa3b-4815-843a-48a3cef38095+8:2352:x1875732240396800:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 Request processed in 359us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838111.536162:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:2.0:1788838111.538719:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838111.538874:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240397056 00000100:00100000:3.0:1788838111.538887:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240397056 00000100:00100000:3.0:1788838111.539055:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:3.0:1788838111.539068:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08402154-aa3b-4815-843a-48a3cef38095+14:14512:x1875732240397056:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788838111.539177:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e79a6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.539199:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e79a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.539459:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e79a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.539800:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a441465600/0x2deb895b363e79ad lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.539827:0:14340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790a00/0x2deb895b363e797c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4fb expref: 15 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.539837:0:14340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a441465600/0x2deb895b363e79ad lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.539885:0:14340:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790a00/0x2deb895b363e797c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4fb expref: 15 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.539903:0:14340:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790a00/0x2deb895b363e797c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4fb expref: 15 pid: 14341 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838111.539936:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a45108f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14340:1875732255059072:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788838111.540166:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a44a010780 going to sleep for 11 seconds 00000100:00100000:1.0:1788838111.544239:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838111.544364:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240397184 00000100:00100000:2.0:1788838111.544376:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240397184 00010000:00010000:2.0:1788838111.544431:0:14326:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790a00/0x2deb895b363e797c lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4fb expref: 16 pid: 14341 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838111.544485:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:2.0:1788838111.544497:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08402154-aa3b-4815-843a-48a3cef38095+16:2351:x1875732240397184:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788838111.544516:0:14326:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838111.544524:0:14326:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790a00/0x2deb895b363e797c lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4fb expref: 16 pid: 14341 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.544538:0:14326:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790a00/0x2deb895b363e797c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4fb expref: 16 pid: 14341 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.544568:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97a448b3c200) 00010000:00010000:2.0:1788838111.544576:0:14326:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a441465600/0x2deb895b363e79ad lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.544588:0:14326:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a441465600/0x2deb895b363e79ad lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.544615:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a441465600/0x2deb895b363e79ad lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.544651:0:14326:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838111.544728:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08402154-aa3b-4815-843a-48a3cef38095+16:2351:x1875732240397184:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 233us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838111.544737:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00010000:00010000:3.0:1788838111.546389:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a46e790a00/0x2deb895b363e797c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4fb expref: 15 pid: 14341 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838111.546423:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a45108f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14340:1875732255059072:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788838111.546455:0:14340:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a441465600/0x2deb895b363e79ad lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.546468:0:14340:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a441465600/0x2deb895b363e79ad lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.546474:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a441465600/0x2deb895b363e79ad lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788838111.546742:0:14340:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1788838111.547098:0:14340:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1788838111.547155:0:14340:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1788838111.547498:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a45108f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14340:1875732255059200:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788838111.549952:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838111.550172:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a448f9f240 going to sleep for 11 seconds 00000100:00100000:1.0:1788838111.550364:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255059200 00000100:00100000:1.0:1788838111.550382:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255059200 00000100:00100000:1.0:1788838111.550454:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788838111.550466:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14340:x1875732255059200:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788838111.550714:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14340:x1875732255059200:12345-0@lo:1000:mdt00_000.0 Request processed in 249us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838111.550741:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788838111.550937:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a45108f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14340:1875732255059200:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788838111.551941:0:14340:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788838111.552065:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7e4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14340:1875732255059328:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788838111.552136:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838111.552276:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a46f4c4180 going to sleep for 11 seconds 00000100:00100000:1.0:1788838111.552324:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255059328 00000100:00100000:1.0:1788838111.552332:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255059328 00000100:00100000:1.0:1788838111.552384:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788838111.552395:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14340:x1875732255059328:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788838111.552671:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14340:x1875732255059328:12345-0@lo:1000:mdt00_000.0 Request processed in 276us (533us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788838111.552679:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788838111.552760:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7e4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14340:1875732255059328:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788838111.552808:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a441465600/0x2deb895b363e79ad lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.552821:0:14340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a441465600/0x2deb895b363e79ad lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.552831:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a441465600/0x2deb895b363e79ad lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.552838:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441465600 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788838111.552844:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a441465600/0x2deb895b363e79ad lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.552921:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a441465600/0x2deb895b363e79ad lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.552963:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97a448b3c200) 00010000:00010000:2.0:1788838111.552967:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788838111.552973:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a441465600/0x2deb895b363e79ad lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.552980:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a441465600/0x2deb895b363e79ad lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.553021:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30200/0x2deb895b363e790c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.553029:0:14340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30200/0x2deb895b363e790c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.553035:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30200/0x2deb895b363e790c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.553040:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d30200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788838111.553043:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30200/0x2deb895b363e790c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.553049:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30200/0x2deb895b363e790c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.553058:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a448b3c500) 00010000:00010000:2.0:1788838111.553060:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788838111.553068:0:14340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e7913 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4df expref: 18 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.553080:0:14340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e7913 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4df expref: 18 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.553099:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e7913 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4df expref: 18 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.553166:0:14340:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48be00/0x2deb895b363e7913 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d4df expref: 18 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838111.553179:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46e7e5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14340:1875732255059456:192.168.204.54@tcp:105: 00000100:00100000:2.0:1788838111.553357:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a46f4c4780 going to sleep for 11 seconds 00000100:00100000:2.0:1788838111.556349:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46e7e5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14340:1875732255059456:192.168.204.54@tcp:105: 00010000:00010000:2.0:1788838111.556387:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30200/0x2deb895b363e790c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.556401:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d30200/0x2deb895b363e790c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.556447:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31600/0x2deb895b363e79b4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.556463:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31600/0x2deb895b363e79b4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.556474:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31600/0x2deb895b363e79b4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.556496:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31600/0x2deb895b363e79b4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.556509:0:14340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31600/0x2deb895b363e79b4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.556544:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31600/0x2deb895b363e79b4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.556550:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d31600 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788838111.556554:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31600/0x2deb895b363e79b4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.556562:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31600/0x2deb895b363e79b4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.556573:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a448b3c500) 00010000:00010000:2.0:1788838111.556577:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838111.556580:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31600/0x2deb895b363e79b4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.556586:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a458d31600/0x2deb895b363e79b4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.556595:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e79a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.556601:0:14340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e79a6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.556606:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e79a6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.556610:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a44a48a200 already unused, calling callback (ffffffffc20354f0) 00010000:00010000:2.0:1788838111.556612:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e79a6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.556640:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e79a6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.556649:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a448b3c500) 00010000:00010000:2.0:1788838111.556651:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788838111.556654:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e79a6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.556659:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a44a48a200/0x2deb895b363e79a6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838111.556912:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08402154-aa3b-4815-843a-48a3cef38095+18:14512:x1875732240397056:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 17844us (18205us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788838111.556922:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 53 00000020:00080000:2.0:1788838111.556929:0:14340:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788838111.557588:0:14371:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788838111.557608:0:14371:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788838111.557667:0:14371:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788838111.557675:0:14371:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788838111.559938:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788838111.560374:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240397312 00000100:00100000:0.0:1788838111.560385:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240397312 00000100:00100000:0.0:1788838111.560450:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:0.0:1788838111.560466:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a344aaf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08402154-aa3b-4815-843a-48a3cef38095+18:14511:x1875732240397312:12345-192.168.204.54@tcp:49:dd.0 00000100:00100000:0.0:1788838111.560879:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a344aaf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08402154-aa3b-4815-843a-48a3cef38095+18:14511:x1875732240397312:12345-192.168.204.54@tcp:49:dd.0 Request processed in 418us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838111.560887:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:1.0:1788838111.567050:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838111.567293:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240397568 00000100:00100000:3.0:1788838111.567303:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240397568 00000100:00100000:3.0:1788838111.567365:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:3.0:1788838111.567375:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08402154-aa3b-4815-843a-48a3cef38095+18:14512:x1875732240397568:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788838111.569198:0:14343:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788838111.569346:0:14343:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1788838111.569403:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a441464c00/0x2deb895b363e79bb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.569424:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a441464c00/0x2deb895b363e79bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.569437:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a441464c00/0x2deb895b363e79bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.569445:0:14343:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a441464c00/0x2deb895b363e79bb lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.569452:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a441464c00/0x2deb895b363e79bb lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.569459:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a441464c00/0x2deb895b363e79bb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.569752:0:14343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788838111.569874:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08402154-aa3b-4815-843a-48a3cef38095+20:14512:x1875732240397568:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 2496us (2830us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1788838111.569883:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000020:00080000:3.0:1788838111.569889:0:14343:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788838111.571886:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838111.571899:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a441464c00/0x2deb895b363e79bb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.571910:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441464c00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:0.0:1788838111.571914:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a441464c00/0x2deb895b363e79bb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.571925:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a441464c00/0x2deb895b363e79bb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.571944:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97a448b3c200) 00010000:00010000:0.0:1788838111.571947:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788838111.571952:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a441464c00/0x2deb895b363e79bb lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.571958:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a441464c00/0x2deb895b363e79bb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.571976:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838111.571995:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838111.571997:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838111.654844:0:16053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838111.808313:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838111.808355:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838111.808401:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788838111.808613:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240397696 00000100:00100000:1.0:1788838111.808637:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240397696 00000100:00100000:1.0:1788838111.808711:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240397824 00000100:00100000:1.0:1788838111.808714:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240397824 00000100:00100000:1.0:1788838111.808729:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240397952 00000100:00100000:1.0:1788838111.808731:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240397952 00000100:00100000:1.0:1788838111.808750:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:1.0:1788838111.808761:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:08402154-aa3b-4815-843a-48a3cef38095+10:2351:x1875732240397696:12345-192.168.204.54@tcp:4:dd.0 00010000:00010000:1.0:1788838111.808823:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f48c5d6/0x2deb895b363e79c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.808850:0:15033:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000886ed532/0x2deb895b363e7991 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d509 expref: 10 pid: 15029 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.808861:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838111.808867:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838111.808872:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f48c5d6/0x2deb895b363e79c2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.808927:0:15033:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000886ed532/0x2deb895b363e7991 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d509 expref: 10 pid: 15029 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.808945:0:15033:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000886ed532/0x2deb895b363e7991 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d509 expref: 10 pid: 15029 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838111.808963:0:15033:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448b74e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:15033:1875732255059584:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788838111.809097:0:15033:0:(client.c:2715:ptlrpc_set_wait()) set ffff97a4673f9600 going to sleep for 11 seconds 00000100:00100000:1.0:1788838111.810825:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788838111.810869:0:3265:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838111.810994:0:15034:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788838111.811005:0:15034:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1788838111.811086:0:15032:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788838111.811111:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240398080 00000100:00100000:0.0:1788838111.811121:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240398080 00000100:00100000:0.0:1788838111.811173:0:15032:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788838111.811178:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240398208 00000100:00100000:0.0:1788838111.811180:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240398208 00000100:00100000:2.0:1788838111.812110:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838111.812152:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788838111.812188:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838111.812290:0:15032:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788838111.812302:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240398336 00000100:00100000:3.0:1788838111.812308:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240398336 00000100:00100000:3.0:1788838111.812350:0:15032:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788838111.812354:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240398464 00000100:00100000:3.0:1788838111.812357:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240398464 00000100:00100000:3.0:1788838111.812368:0:15032:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788838111.812383:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240398592 00000100:00100000:3.0:1788838111.812386:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240398592 00000100:00100000:0.0:1788838111.816482:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:0.0:1788838111.816507:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:08402154-aa3b-4815-843a-48a3cef38095+15:2352:x1875732240397824:12345-192.168.204.54@tcp:4:dd.0 00010000:00010000:0.0:1788838111.816563:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b25ba15/0x2deb895b363e79c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.816587:0:16577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838111.816592:0:16577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838111.816597:0:16577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b25ba15/0x2deb895b363e79c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.816608:0:16577:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b25ba15/0x2deb895b363e79c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838111.818303:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788838111.818376:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240398720 00000100:00100000:0.0:1788838111.818389:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240398720 00010000:00010000:0.0:1788838111.818437:0:14327:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000886ed532/0x2deb895b363e7991 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d509 expref: 16 pid: 15029 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838111.818457:0:15033:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448b74e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:15033:1875732255059584:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788838111.818489:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00010000:00010000:1.0:1788838111.818491:0:15033:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000f48c5d6/0x2deb895b363e79c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838111.818504:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08402154-aa3b-4815-843a-48a3cef38095+16:2352:x1875732240398720:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788838111.818544:0:14327:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838111.818575:0:14327:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000886ed532/0x2deb895b363e7991 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d509 expref: 16 pid: 15029 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.818591:0:14327:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000886ed532/0x2deb895b363e7991 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d509 expref: 16 pid: 15029 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.818632:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000886ed532/0x2deb895b363e7991 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xc3a436432fd0d509 expref: 16 pid: 15029 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.818652:0:14327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838111.818657:0:14327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838111.818663:0:14327:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000f48c5d6/0x2deb895b363e79c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.818675:0:14327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f48c5d6/0x2deb895b363e79c2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.818686:0:14327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838111.818689:0:14327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838111.818693:0:14327:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b25ba15/0x2deb895b363e79c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.818702:0:14327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b25ba15/0x2deb895b363e79c9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.818743:0:14327:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788838111.818764:0:16577:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b25ba15/0x2deb895b363e79c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.818777:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b25ba15/0x2deb895b363e79c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838111.818826:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08402154-aa3b-4815-843a-48a3cef38095+15:2352:x1875732240398720:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 326us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838111.818836:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00010000:00010000:3.0:1788838111.824771:0:15033:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000f48c5d6/0x2deb895b363e79c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.825026:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f48c5d6/0x2deb895b363e79c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788838111.953781:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:2.0:1788838111.953819:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:2.0:1788838111.953831:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:2.0:1788838111.953899:0:16577:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:2.0:1788838111.953905:0:16577:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1788838109 -> 1788838110 00002000:00010000:2.0:1788838111.953908:0:16577:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788838109 -> 1788838110 00002000:00010000:2.0:1788838111.953936:0:16577:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:2.0:1788838111.953957:0:16577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b25ba15/0x2deb895b363e79c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.953974:0:16577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b25ba15/0x2deb895b363e79c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.953984:0:16577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b25ba15/0x2deb895b363e79c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.953992:0:16577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e791000 already unused, calling callback (ffffffffc1616420) 00010000:00010000:2.0:1788838111.953998:0:16577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b25ba15/0x2deb895b363e79c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.954009:0:16577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b25ba15/0x2deb895b363e79c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.954042:0:16577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b25ba15/0x2deb895b363e79c9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.954050:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b25ba15/0x2deb895b363e79c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838111.954179:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:08402154-aa3b-4815-843a-48a3cef38095+15:2352:x1875732240397824:12345-192.168.204.54@tcp:4:dd.0 Request processed in 137671us (145812us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788838111.954258:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:2.0:1788838111.954313:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:2.0:1788838111.954334:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:08402154-aa3b-4815-843a-48a3cef38095+14:2352:x1875732240397952:12345-192.168.204.54@tcp:4:dd.0 00010000:00010000:2.0:1788838111.954393:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003051fb2d/0x2deb895b363e79d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.954409:0:16577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788838111.954414:0:16577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838111.954422:0:16577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003051fb2d/0x2deb895b363e79d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.954436:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003051fb2d/0x2deb895b363e79d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788838112.033668:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:2.0:1788838112.033885:0:15033:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:2.0:1788838112.033892:0:15033:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 4103 00010000:00010000:2.0:1788838112.033911:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f48c5d6/0x2deb895b363e79c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838112.033927:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f48c5d6/0x2deb895b363e79c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838112.033937:0:15033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f48c5d6/0x2deb895b363e79c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838112.033944:0:15033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d3da00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:2.0:1788838112.033950:0:15033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f48c5d6/0x2deb895b363e79c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838112.033985:0:15033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f48c5d6/0x2deb895b363e79c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838112.034010:0:15033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f48c5d6/0x2deb895b363e79c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838112.034018:0:15033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f48c5d6/0x2deb895b363e79c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838112.034152:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:08402154-aa3b-4815-843a-48a3cef38095+14:2351:x1875732240397696:12345-192.168.204.54@tcp:4:dd.0 Request processed in 225386us (225850us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788838112.034163:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:2.0:1788838112.034253:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:2.0:1788838112.034270:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:08402154-aa3b-4815-843a-48a3cef38095+13:2352:x1875732240398080:12345-192.168.204.54@tcp:4:dd.0 00010000:00010000:2.0:1788838112.034315:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000549b5b/0x2deb895b363e79d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838112.034332:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838112.034337:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838112.034345:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000549b5b/0x2deb895b363e79d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838112.034359:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000549b5b/0x2deb895b363e79d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788838112.093930:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:2.0:1788838112.094535:0:16577:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:2.0:1788838112.094542:0:16577:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:2.0:1788838112.094562:0:16577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003051fb2d/0x2deb895b363e79d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838112.094578:0:16577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003051fb2d/0x2deb895b363e79d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838112.094588:0:16577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003051fb2d/0x2deb895b363e79d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838112.094595:0:16577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d31400 already unused, calling callback (ffffffffc1616420) 00010000:00010000:2.0:1788838112.094602:0:16577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003051fb2d/0x2deb895b363e79d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838112.094623:0:16577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003051fb2d/0x2deb895b363e79d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838112.094712:0:16577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003051fb2d/0x2deb895b363e79d0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838112.094720:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003051fb2d/0x2deb895b363e79d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838112.094861:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:08402154-aa3b-4815-843a-48a3cef38095+13:2352:x1875732240397952:12345-192.168.204.54@tcp:4:dd.0 Request processed in 140524us (286450us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788838112.094890:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:2.0:1788838112.094938:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:2.0:1788838112.094956:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:08402154-aa3b-4815-843a-48a3cef38095+12:2352:x1875732240398208:12345-192.168.204.54@tcp:4:dd.0 00010000:00010000:2.0:1788838112.095000:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030050d1a/0x2deb895b363e79de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838112.095014:0:16577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838112.095019:0:16577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838112.095025:0:16577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030050d1a/0x2deb895b363e79de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838112.095039:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030050d1a/0x2deb895b363e79de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838112.185150:0:15033:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:3.0:1788838112.185166:0:15033:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1788838112.185188:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000549b5b/0x2deb895b363e79d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838112.185218:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000549b5b/0x2deb895b363e79d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838112.185229:0:15033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000549b5b/0x2deb895b363e79d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838112.185237:0:15033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d30a00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:3.0:1788838112.185242:0:15033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000549b5b/0x2deb895b363e79d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838112.185253:0:15033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000549b5b/0x2deb895b363e79d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838112.185282:0:15033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000549b5b/0x2deb895b363e79d7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838112.185321:0:15033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000549b5b/0x2deb895b363e79d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838112.185481:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:08402154-aa3b-4815-843a-48a3cef38095+14:2352:x1875732240398080:12345-192.168.204.54@tcp:4:dd.0 Request processed in 151210us (374659us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788838112.185494:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:3.0:1788838112.185546:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:3.0:1788838112.185561:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:08402154-aa3b-4815-843a-48a3cef38095+13:2352:x1875732240398336:12345-192.168.204.54@tcp:4:dd.0 00010000:00010000:3.0:1788838112.185619:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e5ad692/0x2deb895b363e79e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838112.185634:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838112.185639:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838112.185646:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e5ad692/0x2deb895b363e79e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838112.185660:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e5ad692/0x2deb895b363e79e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788838112.198595:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:3.0:1788838112.262745:0:16577:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:3.0:1788838112.262761:0:16577:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:3.0:1788838112.262796:0:16577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030050d1a/0x2deb895b363e79de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838112.262812:0:16577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030050d1a/0x2deb895b363e79de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838112.262839:0:16577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030050d1a/0x2deb895b363e79de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838112.262847:0:16577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a458d31800 already unused, calling callback (ffffffffc1616420) 00010000:00010000:3.0:1788838112.262852:0:16577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030050d1a/0x2deb895b363e79de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838112.262863:0:16577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030050d1a/0x2deb895b363e79de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838112.262888:0:16577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030050d1a/0x2deb895b363e79de lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838112.262896:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030050d1a/0x2deb895b363e79de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838112.263151:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:08402154-aa3b-4815-843a-48a3cef38095+13:2352:x1875732240398208:12345-192.168.204.54@tcp:4:dd.0 Request processed in 168195us (452272us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1788838112.263163:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:3.0:1788838112.263269:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:3.0:1788838112.263285:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:08402154-aa3b-4815-843a-48a3cef38095+12:2352:x1875732240398464:12345-192.168.204.54@tcp:4:dd.0 00010000:00010000:3.0:1788838112.263329:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa142e90/0x2deb895b363e79ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838112.263345:0:16577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838112.263357:0:16577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838112.263364:0:16577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa142e90/0x2deb895b363e79ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838112.263377:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa142e90/0x2deb895b363e79ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788838112.280408:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00000001:00080000:3.0:1788838112.312641:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:0.0:1788838112.316161:0:15033:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:0.0:1788838112.316174:0:15033:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 14343 00010000:00010000:0.0:1788838112.316194:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e5ad692/0x2deb895b363e79e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838112.316243:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e5ad692/0x2deb895b363e79e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838112.316254:0:15033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e5ad692/0x2deb895b363e79e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838112.316262:0:15033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441465e00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:0.0:1788838112.316268:0:15033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e5ad692/0x2deb895b363e79e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838112.316278:0:15033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e5ad692/0x2deb895b363e79e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838112.316304:0:15033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e5ad692/0x2deb895b363e79e5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838112.316314:0:15033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e5ad692/0x2deb895b363e79e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838112.316456:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:08402154-aa3b-4815-843a-48a3cef38095+10:2352:x1875732240398336:12345-192.168.204.54@tcp:4:dd.0 Request processed in 130894us (504344us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788838112.316469:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:0.0:1788838112.316520:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:0.0:1788838112.316535:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:08402154-aa3b-4815-843a-48a3cef38095+9:2352:x1875732240398592:12345-192.168.204.54@tcp:4:dd.0 00010000:00010000:0.0:1788838112.316574:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a99958c/0x2deb895b363e79f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838112.316589:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838112.316593:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838112.316600:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a99958c/0x2deb895b363e79f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838112.316627:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a99958c/0x2deb895b363e79f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788838112.385950:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:1.0:1788838112.386086:0:16577:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00010000:00010000:1.0:1788838112.386108:0:16577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa142e90/0x2deb895b363e79ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838112.386149:0:16577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa142e90/0x2deb895b363e79ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838112.386159:0:16577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa142e90/0x2deb895b363e79ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838112.386167:0:16577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a441464600 already unused, calling callback (ffffffffc1616420) 00010000:00010000:1.0:1788838112.386173:0:16577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa142e90/0x2deb895b363e79ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838112.386183:0:16577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa142e90/0x2deb895b363e79ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838112.386245:0:16577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa142e90/0x2deb895b363e79ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838112.386253:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa142e90/0x2deb895b363e79ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838112.386372:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:08402154-aa3b-4815-843a-48a3cef38095+9:2352:x1875732240398464:12345-192.168.204.54@tcp:4:dd.0 Request processed in 123087us (574213us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788838112.386383:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00002000:00010000:3.0:1788838112.425845:0:15033:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1788838112.425874:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a99958c/0x2deb895b363e79f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838112.425890:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a99958c/0x2deb895b363e79f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838112.425900:0:15033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a99958c/0x2deb895b363e79f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838112.425907:0:15033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a46e790c00 already unused, calling callback (ffffffffc1616420) 00010000:00010000:3.0:1788838112.425914:0:15033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a99958c/0x2deb895b363e79f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838112.425925:0:15033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a99958c/0x2deb895b363e79f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838112.425950:0:15033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a99958c/0x2deb895b363e79f3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838112.425976:0:15033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a99958c/0x2deb895b363e79f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838112.426105:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:08402154-aa3b-4815-843a-48a3cef38095+7:2352:x1875732240398592:12345-192.168.204.54@tcp:4:dd.0 Request processed in 109569us (613909us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788838112.426115:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000001:00080000:0.0:1788838112.428008:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:0.0:1788838112.675514:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838113.442535:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a45108e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732255060096:0@lo:400:kworker.0 00000100:00100000:3.0:1788838113.442661:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838113.442754:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788838113.442761:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a45108e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3273:1875732255059712:0@lo:400:kworker.0 00000100:00100000:3.0:1788838113.442798:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838113.442823:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a45108ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732255060224:0@lo:400:kworker.0 00000100:00100000:3.0:1788838113.442853:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838113.442884:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a45108dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255059840:0@lo:400:kworker.0 00000100:00100000:3.0:1788838113.442916:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838113.442936:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a45108fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732255060352:0@lo:400:kworker.0 00000100:00100000:3.0:1788838113.442965:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838113.442984:0:3271:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788838113.442990:0:3271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a45108df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255059968:0@lo:400:kworker.0 00000100:00100000:3.0:1788838113.443014:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838113.443058:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255060096 00000100:00100000:3.0:1788838113.443067:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255060096 00000100:00100000:3.0:1788838113.443130:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255060224 00000100:00100000:3.0:1788838113.443134:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255060224 00000100:00100000:3.0:1788838113.443182:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255060352 00000100:00100000:3.0:1788838113.443185:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255060352 00000100:00100000:3.0:1788838113.443235:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788838113.443245:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a45108f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732255060096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838113.443308:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a45108f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1875732255060096:12345-0@lo:400:kworker.0 Request processed in 65us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838113.443316:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788838113.443341:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788838113.443347:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1875732255060224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838113.443376:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1875732255060224:12345-0@lo:400:kworker.0 Request processed in 29us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838113.443381:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788838113.443392:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788838113.443398:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1875732255060352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838113.443429:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3271:x1875732255060352:12345-0@lo:400:kworker.0 Request processed in 31us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838113.443435:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788838113.443459:0:15567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255059840 00000100:00100000:3.0:1788838113.443463:0:15567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255059840 00000100:00100000:3.0:1788838113.443490:0:15567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255059968 00000100:00100000:3.0:1788838113.443493:0:15567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255059968 00000100:00100000:3.0:1788838113.443513:0:15567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788838113.443520:0:15567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44765c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255059840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838113.443554:0:15567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44765c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255059840:12345-0@lo:400:kworker.0 Request processed in 34us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838113.443561:0:15567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788838113.443572:0:15567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788838113.443601:0:15567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255059968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838113.443634:0:15567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3271:x1875732255059968:12345-0@lo:400:kworker.0 Request processed in 37us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838113.443641:0:15567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788838113.443671:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788838113.443676:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788838113.443679:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788838113.443725:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a45108df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255059968:0@lo:400:kworker.0 00000100:00100000:3.0:1788838113.443736:0:3271:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1788838113.443742:0:3271:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97a45108c700, transno 8589934595 00000004:00080000:3.0:1788838113.443755:0:3271:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1788838113.443784:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a45108dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3271:1875732255059840:0@lo:400:kworker.0 00000100:00100000:3.0:1788838113.443796:0:3271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a45108fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3271:1875732255060352:0@lo:400:kworker.0 00000100:00100000:2.0:1788838113.444064:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a45108ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3273:1875732255060224:0@lo:400:kworker.0 00000100:00100000:2.0:1788838113.444075:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a45108e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3273:1875732255060096:0@lo:400:kworker.0 00000100:00100000:1.0:1788838113.444595:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255059712 00000100:00100000:1.0:1788838113.444610:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255059712 00000100:00100000:1.0:1788838113.444668:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788838113.444686:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a460088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+19:3273:x1875732255059712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838113.444815:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a460088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfb679d1-2072-4f0b-b15a-39437d2c1c33+19:3273:x1875732255059712:12345-0@lo:400:kworker.0 Request processed in 136us (2012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838113.444830:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788838113.444949:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a45108e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfb679d1-2072-4f0b-b15a-39437d2c1c33:3273:1875732255059712:0@lo:400:kworker.0 00000100:00100000:1.0:1788838113.445126:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a448b74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255060480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788838113.445180:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838113.445252:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255060480 00000100:00100000:1.0:1788838113.445257:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255060480 00000100:00100000:1.0:1788838113.445290:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788838113.445298:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a448b77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255060480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788838113.445717:0:15030:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788838113.445777:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a448b77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3272:x1875732255060480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 479us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838113.445786:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788838113.445837:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a448b74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3272:1875732255060480:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788838113.703734:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838113.954823:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97a46f4d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255060608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788838113.954924:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838113.955068:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732255060608 00000100:00100000:0.0:1788838113.955078:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732255060608 00000100:00100000:0.0:1788838113.955313:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788838113.955325:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46e7e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255060608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788838113.955374:0:15030:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788838113.955436:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46e7e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1875732255060608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838113.955457:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788838113.955646:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97a46f4d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3273:1875732255060608:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788838114.093927:0:16615:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:3.0:1788838114.508632:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838114.508679:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838114.508716:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838114.508741:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838114.508770:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838114.508786:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838114.508805:0:3264:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788838114.508837:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240399104 00000100:00100000:3.0:1788838114.508852:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240399104 00000100:00100000:3.0:1788838114.508916:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240399616 00000100:00100000:3.0:1788838114.508919:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240399616 00000100:00100000:3.0:1788838114.508931:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240399232 00000100:00100000:3.0:1788838114.508934:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240399232 00000100:00100000:3.0:1788838114.508944:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240399488 00000100:00100000:3.0:1788838114.508967:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240399488 00000100:00100000:3.0:1788838114.508989:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:3.0:1788838114.509000:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:08402154-aa3b-4815-843a-48a3cef38095+5:2352:x1875732240399104:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788838114.509093:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:08402154-aa3b-4815-843a-48a3cef38095+5:2352:x1875732240399104:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 94us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838114.509101:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:3.0:1788838114.509122:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:3.0:1788838114.509128:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:820a2285-a5f5-467b-86b4-a6c9f6481f5b+5:2352:x1875732240399616:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788838114.509149:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:820a2285-a5f5-467b-86b4-a6c9f6481f5b+5:2352:x1875732240399616:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 22us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838114.509155:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:3.0:1788838114.509163:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:3.0:1788838114.509168:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:08402154-aa3b-4815-843a-48a3cef38095+5:2352:x1875732240399232:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788838114.509186:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:08402154-aa3b-4815-843a-48a3cef38095+5:2352:x1875732240399232:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 18us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838114.509192:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:3.0:1788838114.509247:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:3.0:1788838114.509254:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:820a2285-a5f5-467b-86b4-a6c9f6481f5b+5:2352:x1875732240399488:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788838114.509274:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:820a2285-a5f5-467b-86b4-a6c9f6481f5b+5:2352:x1875732240399488:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 21us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838114.509280:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:3.0:1788838114.509297:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240399360 00000100:00100000:3.0:1788838114.509301:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240399360 00000100:00100000:3.0:1788838114.509327:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240398976 00000100:00100000:3.0:1788838114.509335:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240398976 00000100:00100000:3.0:1788838114.509356:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:3.0:1788838114.509361:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a40b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:820a2285-a5f5-467b-86b4-a6c9f6481f5b+6:2352:x1875732240399360:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788838114.509394:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a40b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:820a2285-a5f5-467b-86b4-a6c9f6481f5b+6:2352:x1875732240399360:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 33us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838114.509400:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:3.0:1788838114.509410:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:3.0:1788838114.509414:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a44a408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08402154-aa3b-4815-843a-48a3cef38095+20:2352:x1875732240398976:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788838114.509436:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a44a408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08402154-aa3b-4815-843a-48a3cef38095+20:2352:x1875732240398976:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 21us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838114.509442:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00080000:3.0:1788838114.509460:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788838114.509465:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788838114.509467:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788838114.510365:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732240398848 00000100:00100000:1.0:1788838114.510376:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732240398848 00000100:00100000:1.0:1788838114.510434:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 124 00000100:00100000:1.0:1788838114.510443:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a46008b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+13:2352:x1875732240398848:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788838114.510504:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a46008b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2da147b-5a5a-4591-ba5b-bd1ff99f5864+13:2352:x1875732240398848:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 62us (1888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838114.510511:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 124 00000040:00080000:0.0:1788838114.659931:0:14371:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788838114.659948:0:14371:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788838114.659993:0:14371:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788838114.660001:0:14371:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788838114.723142:0:16053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838115.751905:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29755 lines, 29755 kept, 0 dropped, 0 bad.